Optimizing Lucene search for whitespace analyzer.

2016-06-09 Thread apoorv gupta
lowing configuration - Architecture: x86_64 CPU op-mode(s):32-bit, 64-bit CPU(s):8 On-line CPU(s) list: 0-7 Thread(s) per core:1 Core(s) per socket:1 Socket(s): 8 CPU MHz: 2294.686 BogoMIPS: 4589.37 Virtualization typ

Re:Re: ignore score and weight in lucene search

2015-07-30 Thread 丁儒
>only registers matching documents in a bitset: >https://github.com/apache/lucene-solr/blob/lucene_solr_4_10_4/lucene/core/src/java/org/apache/lucene/search/Collector.java#L85 > >You'll have to adapt this if you want to use it in Lucene 5, though, as the >interface chang

Re: ignore score and weight in lucene search

2015-07-30 Thread András Péteri
Collector's javadoc in Lucene 4.x includes a bare minimum example which only registers matching documents in a bitset: https://github.com/apache/lucene-solr/blob/lucene_solr_4_10_4/lucene/core/src/java/org/apache/lucene/search/Collector.java#L85 You'll have to adapt this if you want to

Re: ignore score and weight in lucene search

2015-07-30 Thread Alan Woodward
What version of lucene are you using? From Lucene 5.1 you can tell queries to not report scores, which will give you the speedup you require here. Alan Woodward www.flax.co.uk On 30 Jul 2015, at 05:22, 丁儒 wrote: > > > It seems that ConstantScoreQuery use the Weight and Score of the Query i

Re:Re: ignore score and weight in lucene search

2015-07-29 Thread 丁儒
It seems that ConstantScoreQuery use the Weight and Score of the Query it wrapperd, like TermWeight and TermScorer , so it can't speed up the search, because the weight and score is still calculated. Maybe i make it wrong, but i did some test, the search time of ‘ new ConstantScoreQuery(new T

Re: ignore score and weight in lucene search

2015-07-29 Thread Jack Krupansky
ConstantScoreQuery is the proper approach. What specific failure did you encounter? -- Jack Krupansky On Wed, Jul 29, 2015 at 7:09 AM, 丁儒 wrote: > Hi, all > Currently i'm using lucene. But i don't care the score and weight, i > just need the documents meets the query. I tried some way to ig

ignore score and weight in lucene search

2015-07-29 Thread 丁儒
Hi, all Currently i'm using lucene. But i don't care the score and weight, i just need the documents meets the query. I tried some way to ignore the score, like rewrite TermQury, disable the TermWeight and TermScore, but there are a lot of queries, and this is incompatible with QueryParser.

Re: Request for help with Lucene search engine

2015-06-26 Thread Rim REKIK
ikrim---REGIM Lab., Leading Innovative Research.--- Le Vendredi 26 juin 2015 13h50, Jason Wee a écrit : maybe start with this?  https://svn.apache.org/repos/asf/lucene/dev/trunk/lucene/core/src/test/org/apache/lucene/s

Re: Request for help with Lucene search engine

2015-06-26 Thread Jason Wee
maybe start with this? https://svn.apache.org/repos/asf/lucene/dev/trunk/lucene/core/src/test/org/apache/lucene/search/TestDocValuesScoring.java hth jason On Fri, Jun 26, 2015 at 7:40 PM, Rim REKIK wrote: > Dear, > I m trying Lucene to work with Lucene search engine. But I m asking if &

Request for help with Lucene search engine

2015-06-26 Thread Rim REKIK
Dear, I m trying Lucene to work with Lucene search engine. But I m asking if there are ready examples for scoring documents. Thank you. Regards -- Rim REKIK rim.re...@ieee.org

RE: Lucene search in attachments

2015-02-10 Thread Uwe Schindler
Hi, > -Original Message- > From: sreedevi s [mailto:sreedevi.payik...@gmail.com] > Sent: Tuesday, February 10, 2015 10:46 AM > To: java-user@lucene.apache.org > Subject: Re: Lucene search in attachments > > Hi Uwe, > Thank you for the info update.I will remove the

Re: Lucene search in attachments

2015-02-10 Thread sreedevi s
Uwe > > - > Uwe Schindler > H.-H.-Meier-Allee 63, D-28213 Bremen > http://www.thetaphi.de > eMail: u...@thetaphi.de > > > > -Original Message- > > From: sreedevi s [mailto:sreedevi.payik...@gmail.com] > > Sent: Tuesday, February 10, 2015

RE: Lucene search in attachments

2015-02-10 Thread Uwe Schindler
.payik...@gmail.com] > Sent: Tuesday, February 10, 2015 9:53 AM > To: java-user@lucene.apache.org > Subject: Re: Lucene search in attachments > > Thank you David. Yes, it has a restriction of characters to 1. > But for large files, what could be done in that case? > > Best Reg

Re: Lucene search in attachments

2015-02-10 Thread sreedevi s
No David. By increasing the value or I can set to -1 to make it unlimited but still I cannot assure that my whole text can be searchable, which is still a problem with large files because only the part which is indexed will be searchable. Was looking for some alternatives. Best Regards, Sreedevi S

Re: Lucene search in attachments

2015-02-10 Thread David Pilato
I don’t understand. If you don’t raise this restriction to a higher value (or to -1), all the text won’t be extracted so only a subset of the text will be indexed. Non indexed parts of the text won’t be searchable. Did I misunderstand your question? -- David Pilato | Technical Advocate | Elasti

Re: Lucene search in attachments

2015-02-10 Thread sreedevi s
Thank you David. Yes, it has a restriction of characters to 1. But for large files, what could be done in that case? Best Regards, Sreedevi S On Tue, Feb 10, 2015 at 2:04 PM, David Pilato wrote: > If you don’t index content, you won’t be able to search for it I guess. > That said, Tika can

Re: Lucene search in attachments

2015-02-10 Thread David Pilato
If you don’t index content, you won’t be able to search for it I guess. That said, Tika can have this extracted characters limit. See indexedChars below: tika().parseToString(new BytesStreamInput(content, false), metadata, indexedChars); [1] https://github.com/elasticsearch/elasticsearch-mappe

Lucene search in attachments

2015-02-10 Thread sreedevi s
Hi, Which is the best method to search in attachments in lucene? I am new to lucene and I am using version 4.10.2. By making use of Tika, I know I can convert files to text and then index it as another field. But for large files that will not be the ideal solution. I believe the maximum charact

Re: Lucene search/count performance abrupt degradation (MMapDirectory)

2015-01-08 Thread Erick Erickson
be it of Lucene, Java or OS origin), while in our opinion it is the most > accurate term for this rather bizarre case. > > Regards > Piotr > > On Tue, Dec 23, 2014 at 9:32 PM, Piotr Idzikowski > wrote: > >> Hello. >> >> I have a performance problem with Lucene s

Re: Lucene search/count performance abrupt degradation (MMapDirectory)

2015-01-08 Thread Piotr Idzikowski
wrote: > Hello. > > I have a performance problem with Lucene search queries running on Java > 7u71 Linux platform. I use the newest 4.10 version, but we also experience > the same problem with Lucene 4.7.2. > > I observed that after some time (1 or 2 days), even without any

Lucene search/count performance abrupt degradation (MMapDirectory)

2014-12-23 Thread Piotr Idzikowski
Hello. I have a performance problem with Lucene search queries running on Java 7u71 Linux platform. I use the newest 4.10 version, but we also experience the same problem with Lucene 4.7.2. I observed that after some time (1 or 2 days), even without any heavy use, Lucene search and count slow

Re: Lucene Search and Disk I/O

2013-12-20 Thread wactioner
nabble.com/Lucene-Search-and-Disk-I-O-tp4107540p4107650.html Sent from the Lucene - Java Users mailing list archive at Nabble.com. - To unsubscribe, e-mail: java-user-unsubscr...@lucene.apache.org For additional commands, e-mail: j

Re: Lucene Search and Disk I/O

2013-12-20 Thread Michael McCandless
d-disk-I-O-td714698.html> > a few years earlier. > > How does a lucene search handle disk I/O and reading from index files? I'm > not sure how much the previous answer stands true. I notice that some of the > index files referenced in the last answer (.tii files) don't exi

Lucene Search and Disk I/O

2013-12-20 Thread wactioner
I had a similar question posted here <http://lucene.472066.n3.nabble.com/Understanding-lucene-indexes-and-disk-I-O-td714698.html> a few years earlier. How does a lucene search handle disk I/O and reading from index files? I'm not sure how much the previous answer stands true. I

Re: how to consider special character like + ! @ # in Lucene search

2013-04-10 Thread Jack Krupansky
: how to consider special character like + ! @ # in Lucene search hello, im using Lucene2.9. i have to search special character like "/" in given text. but when im searching it gives me 0 hit. I have tried QueryParse.escape("/"). but did not get the result. how to pro

Re: Re: how do I paginate Lucene search results deeply

2013-03-14 Thread dizh
Again: searchAfter is good, but when you do Web paging, you will never know The user go to which page. Unlike google or yahoo... they only give you max 76 page as I see. In my scenario, user can go to 10-20 or 20-30 and then again 10-20 by the way , the timestamp I stored is long, using: System

Re: how do I paginate Lucene search results deeply

2013-03-14 Thread Michael McCandless
You could also use Lucene's "search after" capability. It's designed for exactly this use-case (deep paging). See https://issues.apache.org/jira/browse/LUCENE-2215 Mike McCandless http://blog.mikemccandless.com On Thu, Mar 14, 2013 at 6:03 AM, Toke Eskildsen wrote: > On Thu, 2013-03-14 at 04

Re: how do I paginate Lucene search results deeply

2013-03-14 Thread Toke Eskildsen
On Thu, 2013-03-14 at 11:03 +0100, Toke Eskildsen wrote: > (timestamp_in_ms << 10) & counter++ This should be (timestamp_in_ms << 10) | counter++ - To unsubscribe, e-mail: java-user-unsubscr...@lucene.apache.org For additi

Re: how do I paginate Lucene search results deeply

2013-03-14 Thread Toke Eskildsen
On Thu, 2013-03-14 at 04:11 +0100, dizh wrote: > each document has a timestamp identify the time which it is indexed, I > want search the documents using sort, the sort field is the timestamp, [...] > but when you do paging, for example in a web app , the user want to go > to the last 4980-50

how do I paginate Lucene search results deeply

2013-03-13 Thread dizh
Hi, Again, I will ask a Long-Time question, It has been asked for many time, but I googled a lot , but no good solution: I asked one time before, but I think the answer is not very well, SO: The scenario: I indexed 500 documents, Of course it can be more 1000/2000/... each docu

Re: Restrict Lucene search in concrete document ids

2012-10-22 Thread sxam
Because that was still way too slow and I am looking whether I can use this information that I got (document Ids) to speed things up... -- View this message in context: http://lucene.472066.n3.nabble.com/Restrict-Lucene-search-in-concrete-document-ids-tp4013905p4015138.html Sent from the

Re: Restrict Lucene search in concrete document ids

2012-10-22 Thread Rafał Kuć
over results: " + > sw.ElapsedMilliseconds); > +return result; > +} > +} > The problem with that code is that it takes too much time.. That's why I > tried to filter by DocumentId somehow, but couldn't find the proper ifc.

Re: Restrict Lucene search in concrete document ids

2012-10-22 Thread sxam
s message in context: http://lucene.472066.n3.nabble.com/Restrict-Lucene-search-in-concrete-document-ids-tp4013905p4015123.html Sent from the Lucene - Java Users mailing list archive at Nabble.com. - To unsubscribe, e-mail: java-

Re: Restrict Lucene search in concrete document ids

2012-10-22 Thread Ian Lea
m the indexReader I > get in the method? > I can see the documents by indexReader.Documents, but no id there.. > > > > -- > View this message in context: > http://lucene.472066.n3.nabble.com/Restrict-Lucene-search-in-concrete-document-ids-tp4013905p4015074.html > Se

Re: Restrict Lucene search in concrete document ids

2012-10-22 Thread sxam
.nabble.com/Restrict-Lucene-search-in-concrete-document-ids-tp4013905p4015074.html Sent from the Lucene - Java Users mailing list archive at Nabble.com. - To unsubscribe, e-mail: java-user-unsubscr...@lucene.apache.org For

Re: Restrict Lucene search in concrete document ids

2012-10-17 Thread Ian Lea
I add Document Id as a clause (to Filter/Query), BTW? > > > > -- > View this message in context: > http://lucene.472066.n3.nabble.com/Restrict-Lucene-search-in-concrete-document-ids-tp4013905p4014258.html

Re: Restrict Lucene search in concrete document ids

2012-10-17 Thread sxam
sage in context: http://lucene.472066.n3.nabble.com/Restrict-Lucene-search-in-concrete-document-ids-tp4013905p4014258.html Sent from the Lucene - Java Users mailing list archive at Nabble.com. - To unsubscribe, e-mail: jav

Re: Restrict Lucene search in concrete document ids

2012-10-16 Thread Erick Erickson
elds or anything, I >> > know the possible document ids before so if possible I wouldn't want to >> use >> > Query.. Besides it would be a huge query (let's say I want to limit to >> 5,000 >> > documents ids, it would be 5,000 Clauses..). >> > >

Re: Restrict Lucene search in concrete document ids

2012-10-16 Thread Erick Erickson
ments ids, it would be 5,000 Clauses..). > > Any help is greatly appreciated, > > Maxim > > > > -- > View this message in context: > http://lucene.472066.n3.nabble.com/Restrict-Lucene-search-in-concrete-document-ids-tp4013905.html >

Restrict Lucene search in concrete document ids

2012-10-16 Thread sxam
;t want to use Query.. Besides it would be a huge query (let's say I want to limit to 5,000 documents ids, it would be 5,000 Clauses..). Any help is greatly appreciated, Maxim -- View this message in context: http://lucene.472066.n3.nabble.com/Restrict-Lucene-search-in-concrete-documen

Re: Mapping Lucene search results with a relational database

2012-07-03 Thread mark harwood
o but it is one that I've encountered many times. Cheers Mark - Original Message - From: Jochen Hebbrecht To: java-user@lucene.apache.org Cc: Sent: Tuesday, 3 July 2012, 8:56 Subject: Mapping Lucene search results with a relational database Hi all, I have an application w

Re: Mapping Lucene search results with a relational database

2012-07-03 Thread Jochen Hebbrecht
Hi Feng, Hmmm, but Document is a Java object? It holds all kinds of other objects like Sets, Lists, Maps, Strings, Doubles, ... Can we store Java objects in a Lucene index? Jochen 2012/7/3 feng lu > and you can add d as a field with STORE and NOT_ANALYZER tag to it if d in > Document is not l

Re: Mapping Lucene search results with a relational database

2012-07-03 Thread Jochen Hebbrecht
Hi Chris, Yeah! That's a possibility, thanks :-)! Jochen 2012/7/3 Chris Lu > Can you index the rule1 and rule2 fields into the documents, and when > searching with the keywords, also append rule1:foo and rule2:bar to the > query? > > Chris > - > Instant Scalable Full-T

Re: Mapping Lucene search results with a relational database

2012-07-03 Thread feng lu
and you can add d as a field with STORE and NOT_ANALYZER tag to it if d in Document is not large. On Tue, Jul 3, 2012 at 4:04 PM, Chris Lu wrote: > Can you index the rule1 and rule2 fields into the documents, and when > searching with the keywords, also append rule1:foo and rule2:bar to the > qu

Re: Mapping Lucene search results with a relational database

2012-07-03 Thread Chris Lu
Can you index the rule1 and rule2 fields into the documents, and when searching with the keywords, also append rule1:foo and rule2:bar to the query? Chris - Instant Scalable Full-Text Search On Any Database/Application site: http://www.dbsight.net demo: http://search.dbs

Mapping Lucene search results with a relational database

2012-07-03 Thread Jochen Hebbrecht
Hi all, I have an application which holds a list of documents. These documents are indexed using Lucene. I can search on keywords of the documents. I loop the TopDocs and get the ID field (of each Lucene doc) which is related to the ID column in my relational database. From all these ID's, I creat

Re: lucene (search) performance tuning

2012-05-28 Thread Lance Norskog
And, no RamDirectory does not help. On Mon, May 28, 2012 at 5:54 PM, Lance Norskog wrote: > Can you use filter queries? Filters short-circuit a lot of search > processing. "City:San Francisco" is a classic filter - it is a small > part of the documents and it is reused a lot. > > On Sat, May 26,

Re: lucene (search) performance tuning

2012-05-28 Thread Lance Norskog
Can you use filter queries? Filters short-circuit a lot of search processing. "City:San Francisco" is a classic filter - it is a small part of the documents and it is reused a lot. On Sat, May 26, 2012 at 7:32 AM, Yang wrote: > I'm using disjunction (OR) query. unfortunately all of the clauses ar

Re: lucene (search) performance tuning

2012-05-26 Thread Yang
I'm using disjunction (OR) query. unfortunately all of the clauses are optional On Sat, May 26, 2012 at 4:38 AM, Simon Willnauer < simon.willna...@googlemail.com> wrote: > On Sat, May 26, 2012 at 2:59 AM, Yang wrote: > > I tested with more threads / processes. indeed this is completely > > cpu-b

Re: lucene (search) performance tuning

2012-05-26 Thread Li Li
if you don't score but sort by id, it may be a little bit faster. but for 3.x, you can hardly speed up by simpler scoring function. for your situation, the bottleneck is cpu. you can speed up by paralleling. so the best one is to split index and searching concurrently. so the cpus can be fully used

Re: lucene (search) performance tuning

2012-05-26 Thread Simon Willnauer
On Sat, May 26, 2012 at 2:59 AM, Yang wrote: > I tested with more threads / processes. indeed this is completely > cpu-bound, since running 1 thread gives the same latency as 4 threads (my > box has 4 cores) > > > given this, is there any way to simplify the scoring computation (i'm only > using l

Re: lucene (search) performance tuning

2012-05-25 Thread Yang
I tested with more threads / processes. indeed this is completely cpu-bound, since running 1 thread gives the same latency as 4 threads (my box has 4 cores) given this, is there any way to simplify the scoring computation (i'm only using lucene as a first level "rough" search, so the search quali

Re: lucene (search) performance tuning

2012-05-25 Thread Yang
thanks a lot guys On Tue, May 22, 2012 at 1:34 AM, Ian Lea wrote: > Lots of good tips in > http://wiki.apache.org/lucene-java/ImproveSearchingSpeed, linked from > the FAQ. > > > -- > Ian. > > > On Tue, May 22, 2012 at 2:08 AM, Li Li wrote: > > something wrong when writing in my android client.

Re: lucene (search) performance tuning

2012-05-22 Thread Ian Lea
Lots of good tips in http://wiki.apache.org/lucene-java/ImproveSearchingSpeed, linked from the FAQ. -- Ian. On Tue, May 22, 2012 at 2:08 AM, Li Li wrote: > something wrong when writing in my android client. > if RAMDirectory do not help, i think the bottleneck is cpu. you may try to > tune jvm

Re: lucene (search) performance tuning

2012-05-21 Thread Li Li
something wrong when writing in my android client. if RAMDirectory do not help, i think the bottleneck is cpu. you may try to tune jvm but i do not expect much improvement. the best one is splitting your index into 2 or more smaller ones. you can then use solr s distributed searching. if the cpu is

Re: lucene (search) performance tuning

2012-05-21 Thread Li Li
在 2012-5-22 凌晨4:59,"Yang" 写道: > > I'm trying to make my search faster. right now a query like > > name:Joe Moe Pizza address:77 main street city:San Francisco >is this a conjunction query or a disjunction query? > in a index with 20mil such short business descriptions (total size about 3GB) take

mongodb rest server with lucene search

2012-05-08 Thread Andrei
I wrote mongodb rest server with lucene search Would be happy if anyone try it https://sites.google.com/site/mongodbjavarestserver/home - To unsubscribe, e-mail: java-user-unsubscr...@lucene.apache.org For additional commands, e

Combining Lucene Search Results and external Search

2012-03-22 Thread Marten Deinum
Hi All, We've inherited an application which indexes a lot of data, recently we added another source and indexing of this particular source takes about 2 to 3 weeks (which is a bit long). One of the main problems is that the only API we have to harvest and index the data from that source is a sear

Re: Improving Lucene Search Performance

2011-12-09 Thread Chris Hostetter
: Subject: Improving Lucene Search Performance : In-Reply-To: : : References: : <161fd7d0-e01f-42f2-a02a-a4e4b182c...@ebi.ac.uk><347A161B-6C7B-4DC3-ACD0-9A804E2 : dd...@ebi.ac.uk><007613f0-8529-47a3-95c4-7839e1d3e...@ebi.ac.uk> : https://people.apache.org/~hos

Re: Improving Lucene Search Performance

2011-12-08 Thread Ian Lea
See http://wiki.apache.org/lucene-java/ImproveSearchingSpeed. Some of the tips relate to indexing but most to search time stuff. -- Ian. On Thu, Dec 8, 2011 at 10:45 AM, Dilshad K. P. wrote: > Hi, > Is there any thing to take care while creating index for improving lucene > text search speed

Improving Lucene Search Performance

2011-12-08 Thread Dilshad K. P.
Hi, Is there any thing to take care while creating index for improving lucene text search speed. Thanks And Regards Dilshad K.P * Confidentiality Statement/Disclaimer * This message and any attachments is intended for the sole use of the intended recipient. It may contain confidential i

Re: Adding Lucene Search Capability to an Android app

2011-08-15 Thread Simon Willnauer
I have done it, its possible! :) Problems occur especially during indexing etc. since you have very limited resources. If you are using lucene 3.x you should be able to use a plain vanilla lucene jar and everything should work just fine. if you have more detailed questions I am happy to help. simo

Adding Lucene Search Capability to an Android app

2011-08-15 Thread David Linde
I am wanting to add lucene searching capability to my android app. I have trying to find out if anyone has done this yet? IF its possible? and what problems, or draw backs other people have had adding lucene to their droid app. I know the Droid has several different search options like SQLite FTS a

Re: Memory leak with Lucene Search ?

2011-07-12 Thread Ian Lea
lter are used. I tried looking into Lucene > code also a bit, but couldn't find any clues. > > Does anyone have any pointers as to why this could be happening ? > > Thanks! > Abhay > > -- > View this message in context: > http://lucene.472066.n3.nabble.com/

Memory leak with Lucene Search ?

2011-07-12 Thread dangabhay
r and CachingWrapperFilter are used. I tried looking into Lucene code also a bit, but couldn't find any clues. Does anyone have any pointers as to why this could be happening ? Thanks! Abhay -- View this message in context: http://lucene.472066.n3.nabble.com/Memory-leak-with-Lucene-Search-tp31620

Re: How do I sort lucene search results by relevance and time?

2011-05-11 Thread Otis Gospodnetic
a-user@lucene.apache.org > Sent: Sun, May 8, 2011 11:59:11 PM > Subject: How do I sort lucene search results by relevance and time? > > What do I want to do is just like Google search results. The results in the > first page is the most relevant and also recent documents, but not &

Re: How do I sort lucene search results by relevance and time?

2011-05-10 Thread Johnbin Wang
Thanks for your suggestion! I try to set document boost factor when indexing document. In order to bubble up recent documents' scores, I set last three month's documents' boost to 2 , and set other documents' boost factor to 0.5. The I search index sorting by two fields, lucene default score and

Re: How do I sort lucene search results by relevance and time?

2011-05-09 Thread Ian Lea
Well, you can use one of the sorting search methods and pass multiple sort keys including relevance and a timestamp. But I suspect the Google algorithm may be a bit more complex than that. One technique is boosting: set an index time document boost on recent documents. Of course what is recent t

How do I sort lucene search results by relevance and time?

2011-05-08 Thread Johnbin Wang
What do I want to do is just like Google search results. The results in the first page is the most relevant and also recent documents, but not absolutely sorted by time desc. -- cheers, Johnbin Wang

Re: some basic questions on how Lucene/search engines work

2011-04-13 Thread Yang
thanks a lot for the detailed info! On Wed, Apr 13, 2011 at 4:43 AM, Grant Ingersoll wrote: > > On Apr 7, 2011, at 9:17 PM, Yang wrote: > >> I'm new to lucene/search engine , and have been struggling with these >> questions recently. >> I'd appreciate a lot

Re: some basic questions on how Lucene/search engines work

2011-04-13 Thread Grant Ingersoll
On Apr 7, 2011, at 9:17 PM, Yang wrote: > I'm new to lucene/search engine , and have been struggling with these > questions recently. > I'd appreciate a lot of you could shed some light on this. > > > let's say I do a query on > > dog greyhound > &

some basic questions on how Lucene/search engines work

2011-04-07 Thread Yang
I'm new to lucene/search engine , and have been struggling with these questions recently. I'd appreciate a lot of you could shed some light on this. let's say I do a query on dog greyhound note that I did not quote them, i.e. this is not a phrase search. what happens under th

RE: Lucene search result produced wrong result (due to java Collation)?

2011-02-28 Thread Toke Eskildsen
On Mon, 2011-02-28 at 22:44 +0100, Zhang, Lisheng wrote: > Very sorry I made a typo, what I meant to say is that lucene sort produced > wrong > result in English names (String ASC): > > liu yu > l yy The standard Java Collator ignores whitespace. It can be hacked, but you will have to write your

RE: Lucene search result produced wrong result (due to java Collation)?

2011-02-28 Thread Zhang, Lisheng
helps, Lisheng -Original Message- From: Zhang, Lisheng [mailto:lisheng.zh...@broadvision.com] Sent: Saturday, February 26, 2011 5:00 PM To: java-user@lucene.apache.org Subject: Lucene search result produced wrong result (due to java Collation)? Hi, Today I have noticed that sometimes

Lucene search result produced wrong result (due to java Collation)?

2011-02-26 Thread Zhang, Lisheng
Hi, Today I have noticed that sometimes lucene sort produced strange result in plain English names, like (String ASC) l yy liu yu I traced to lucene source code, it seems to be a java English Collator problem (I set Locale.English to SortField), below I reproduced issue by a trivial code (pu

Re: java.lang.NoClassDefFoundError:org/apache/lucene/search/similar/MoreLikeThis

2010-12-07 Thread starz10de
Dear Erick , thanks a lot, I placed the jar file in WEB-INF\lib and it works. best -- View this message in context: http://lucene.472066.n3.nabble.com/java-lang-NoClassDefFoundError-org-apache-lucene-search-similar-MoreLikeThis-tp2036296p2037181.html Sent from the Lucene - Java Users mailing

Re: java.lang.NoClassDefFoundError:org/apache/lucene/search/similar/MoreLikeThis

2010-12-07 Thread Erick Erickson
ne to find more similar documents in > the index to the giving one. It works fine when I run it directly from > Eclipse but when I call it from my servlet I have this error: > > > “java.lang.NoClassDefFoundError:org/apache/lucene/search/similar/MoreLikeThis“ > > Any idea why this e

java.lang.NoClassDefFoundError:org/apache/lucene/search/similar/MoreLikeThis

2010-12-07 Thread starz10de
Hi All, I am using MoreLikeThis class in lucene to find more similar documents in the index to the giving one. It works fine when I run it directly from Eclipse but when I call it from my servlet I have this error: “java.lang.NoClassDefFoundError:org/apache/lucene/search/similar/MoreLikeThis

Re: VM options for faster lucene search

2010-04-26 Thread Harsh Srivastava
draw > > > On Mon, Apr 26, 2010 at 12:26 PM, Harsh Srivastava wrote: > >> Hi all, >> >> Please suggest VM options for faster lucene search for 23G index. >> I am using lucene version 2.9.2 and java version 1.6 . >> >> -- >> E

Re: VM options for faster lucene search

2010-04-26 Thread Anshum
to me. The distinction is yours to draw On Mon, Apr 26, 2010 at 12:26 PM, Harsh Srivastava wrote: > Hi all, > > Please suggest VM options for faster lucene search for 23G index. > I am using lucene version 2.9.2 and java version 1.6 . > > --

VM options for faster lucene search

2010-04-25 Thread Harsh Srivastava
Hi all, Please suggest VM options for faster lucene search for 23G index. I am using lucene version 2.9.2 and java version 1.6 . -- Er. Harsh Srivastava - To unsubscribe, e-mail: java-user-unsubscr...@lucene.apache.org For

Re: how lucene search works in memory

2010-03-23 Thread Erick Erickson
First, I'd be sure you need to. See the following: http://wiki.apache.org/lucene-java/ImproveSearchingSpeed A lot of very bright people have worked very hard at optimizing Lucene's search *and* the op system caching. I'd carefully examine m

Re: how lucene search works in memory

2010-03-23 Thread Anshum
Hi Suman, I couldn't find a link but talking about approaches to load an index into memory would be : 1. Create a tmpfs partition and copy your index into the partition, open the index reader/searcher from the tmpfs. * You would have to handle the copying/management of indexes in this case. * I

how lucene search works in memory

2010-03-23 Thread suman . holani
Hello, I am trying for optimizing the searching by putting indexes onto memory. RAMDirectory is not option for me, as I am transferring indexes built to slave system to use. So if u could let me know that how to place my indexes onto memory(m thinking of using mmap) .For this I wanna know how exa

Re: Optimising the lucene search

2010-03-23 Thread Anshum
facts expressed here belong to everybody, the opinions to me. The distinction is yours to draw On Tue, Mar 23, 2010 at 12:31 PM, wrote: > > > Hello, > > Optimising the lucene search > > Use combined search field for all text fields instead (or on the top) of > ind

Optimising the lucene search

2010-03-23 Thread suman . holani
Hello, Optimising the lucene search Use combined search field for all text fields instead (or on the top) of indexing them separately and searching with complex query like field1:query OR field2:query ... OR fieldN:query Reducing number of field make indexing and search much faster. Use

RE: Improving Zend lucene search - general guidance?

2010-02-19 Thread Zhang, Lisheng
] Sent: Friday, February 19, 2010 3:15 PM To: java-user@lucene.apache.org Subject: Re: Improving Zend lucene search - general guidance? PHP doesn't have java like "static" variables, right? They are "stateless". All the information like term info that's loaded in th

Re: Improving Zend lucene search - general guidance?

2010-02-19 Thread Chris Lu
PHP doesn't have java like "static" variables, right? They are "stateless". All the information like term info that's loaded in the memory will be gone for the next search. You should use DBSight if you just have one week. -- Chris Lu - Instant Scalable Full-Text Searc

Improving Zend lucene search - general guidance?

2010-02-19 Thread Zhang, Lisheng
Hi, I have been using Java/lucene for a few years and it works well for me. Recently we started to use PHP/lucene from Zend, I found some problems, especially that for each query, it immediately loads whole term id/score (other info..) array into memory, this would cause memory exhausion if t

Re: lucene search

2010-01-29 Thread andy green
Thanks -- View this message in context: http://old.nabble.com/lucene-search-tp27358766p27367213.html Sent from the Lucene - Java Users mailing list archive at Nabble.com. - To unsubscribe, e-mail: java-user

Re: lucene search

2010-01-28 Thread Erick Erickson
or > searching), > I get nothing ... I must enter the real entire code ... "lpg" > > In addition my research does not react with "figures" or characters such as > "_" > > How can I do? I think that the problem may be due to "analyzer&

Re: lucene search

2010-01-28 Thread Shashi Kant
ching), > I get nothing ... I must enter the real entire code  ... "lpg" > > In addition my research does not react with "figures" or characters such as > "_" > > How can I do? I think that the problem may be due to "analyzer" I chose? (I > tri

lucene search

2010-01-28 Thread andy green
code ... "lpg" In addition my research does not react with "figures" or characters such as "_" How can I do? I think that the problem may be due to "analyzer" I chose? (I tried to use "SimpleAnalyser" or "StandardAnalyser) Thank you for you

Re: how to extract text from the result document in lucene search

2009-10-28 Thread DHIVYA M
Okay sir. Let me then try out with lucene 2.4.0 demos. --- On Wed, 10/28/09, Anshum wrote: From: Anshum Subject: Re: how to extract text from the result document in lucene search To: java-user@lucene.apache.org Date: Wednesday, October 28, 2009, 11:20 AM I wouldn't have a reference

Re: how to extract text from the result document in lucene search

2009-10-28 Thread Anshum
o include that highlight class? > Can you please let me know the procedure of using it? > > Thanks in advance > Dhivya > > > --- On Wed, 10/28/09, Anshum wrote: > > > From: Anshum > Subject: Re: how to extract text from the result document in lucene search > To: java-us

Re: how to extract text from the result document in lucene search

2009-10-28 Thread DHIVYA M
document in lucene search To: java-user@lucene.apache.org Date: Wednesday, October 28, 2009, 10:59 AM I guess it should be available starting 1.9 onwards and patch-able with a few changes for even 1.4. -- Anshum Gupta Naukri Labs! http://ai-cafe.blogspot.com The facts expressed here belong to

Re: how to extract text from the result document in lucene search

2009-10-28 Thread Anshum
:24 PM, DHIVYA M wrote: > ya i found sir. > May i know from which version is it available? > > > --- On Wed, 10/28/09, Anshum wrote: > > > From: Anshum > Subject: Re: how to extract text from the result document in lucene search > To: java-user@lucene.apache.org >

Re: how to extract text from the result document in lucene search

2009-10-28 Thread DHIVYA M
ya i found sir. May i know from which version is it available? --- On Wed, 10/28/09, Anshum wrote: From: Anshum Subject: Re: how to extract text from the result document in lucene search To: java-user@lucene.apache.org Date: Wednesday, October 28, 2009, 10:51 AM Yes Dhivya, there

Re: how to extract text from the result document in lucene search

2009-10-28 Thread Anshum
t; Thats exactly matching my need sir. > Thanx a lot > But is this highlighter in lucene 2.4.0? > > --- On Wed, 10/28/09, Benjamin Heilbrunn wrote: > > > From: Benjamin Heilbrunn > Subject: Re: how to extract text from the result document in lucene search > To: java-user@

Re: how to extract text from the result document in lucene search

2009-10-28 Thread DHIVYA M
Thats exactly matching my need sir. Thanx a lot But is this highlighter in lucene 2.4.0? --- On Wed, 10/28/09, Benjamin Heilbrunn wrote: From: Benjamin Heilbrunn Subject: Re: how to extract text from the result document in lucene search To: java-user@lucene.apache.org Date: Wednesday

  1   2   3   4   5   >