Re: Highlighter error with Lucene 6

2016-06-30 Thread Anna Berruezo
Well, I solved the problem on my own. I didn't find anything because it was a conflict between package's dependencies. Thanks anyway! (and make sure all you Lucene's packages have the same version in your Maven configuration) Anna On Wed, Jun 29, 2016 at 7:01 PM, Anna Berruezo wrote: > Hi, >

Re: highlighter with query over more than one word

2016-06-03 Thread David Smiley
It would help tremendously if you can give a specific code example showing the problem. On Thu, Jun 2, 2016 at 6:41 AM Sascha Janz wrote: > > we use highlighter to get textfragments for our hit list. > > the code is straight forward like this > >Analyzer analyzer = new StandardAnalyzer(; >

Re: Highlighter throws ClassCastException TextFragment cannot be cast to DocumentFragment

2012-12-27 Thread Bin Lan
Woops, please ignore this. There is a mixed version of jar file... Sorry about this. Regards -- Bin Lan Software Developer Perimeter E-Security O - (203)541-3412 Follow Us on Twitter: www.twitter.com/PerimeterNews Read Our Blog: security.perimeterusa.com/blog On Thu, Dec 27, 2012 at 3:39 PM

RE: Highlighter IOOBE with modified HyphenationCompoundWordTokenFilter

2012-10-05 Thread Markus Jelsma
- > From:Thomas Matthijs > Sent: Thu 04-Oct-2012 15:55 > To: java-user@lucene.apache.org > Subject: Re: Highlighter IOOBE with modified > HyphenationCompoundWordTokenFilter > > And to include the code > > On Thu, Oct 4, 2012 at 3:52 PM, Markus Jelsma > wrote: > &

Re: Highlighter IOOBE with modified HyphenationCompoundWordTokenFilter

2012-10-04 Thread Thomas Matthijs
And to include the code On Thu, Oct 4, 2012 at 3:52 PM, Markus Jelsma wrote: > I forgot to add that this is with today's build of trunk. > > -Original message- >> From:Markus Jelsma >> Sent: Thu 04-Oct-2012 15:42 >> To: java-user@lucene.apache.org >> Subject: Highlighter IOOBE with modif

RE: Highlighter IOOBE with modified HyphenationCompoundWordTokenFilter

2012-10-04 Thread Markus Jelsma
I forgot to add that this is with today's build of trunk. -Original message- > From:Markus Jelsma > Sent: Thu 04-Oct-2012 15:42 > To: java-user@lucene.apache.org > Subject: Highlighter IOOBE with modified HyphenationCompoundWordTokenFilter > > Hi, > > I've modified the HyphenationComp

Re: Highlighter and Shingles...

2012-04-21 Thread Dawn Zoë Raison
Steve, Exactly the right question... Prompted by your question, further investigation reveals that I need to move the "access" part of my lucene query into a filter to prevent non-matching documents getting scored. In that situation of course the highlighter finds nothing to highlight - that'

RE: Highlighter and Shingles...

2012-04-20 Thread Steven A Rowe
Hi Dawn, Can you give an example of a "partial match"? Steve -Original Message- From: Dawn Zoë Raison [mailto:d...@digitorial.co.uk] Sent: Friday, April 20, 2012 7:59 AM To: java-user@lucene.apache.org Subject: Highlighter and Shingles... Hi, Are there any notes on making the highligh

Re: highlighter: how can I get locations of fragments?

2011-12-14 Thread Chris Hostetter
: Subject: highlighter: how can I get locations of fragments? : References: <4ee79b27.1010...@wyona.com> : In-Reply-To: <4ee79b27.1010...@wyona.com> https://people.apache.org/~hossman/#threadhijack Thread Hijacking on Mailing Lists When starting a new discussion on a mailing list, please do not

Re: highlighter by using term offsets

2011-11-24 Thread Ian Lea
That is neither the smallest possible code to show the problem, nor self-contained. My guess would be that "reader" in your offending line is the culprit. It isn't shown anywhere else in your code so, from the evidence you've provided, it is reasonable to think it might be null. > hits[i].doc re

Re: highlighter by using term offsets

2011-11-24 Thread starz10de
Hi, here is the full part of the code: public static void doPagingSearch(BufferedReader in, Searcher searcher, Query query, int hitsPerPage, boolean raw, boolean interactive) throws IOException, ParseException, InvalidTokenOffsetsException {

Re: highlighter by using term offsets

2011-11-24 Thread Ian Lea
OK, so you've ruled out one possible cause. Progress! But if you're getting NPE on line 274 and line 274 reads TermPositionVector tpv = (TermPositionVector)reader.getTermFreqVector(hits[i].doc,"contents"); then something is null where it shouldn't be. Rule out everything you can and what is le

Re: highlighter by using term offsets

2011-11-24 Thread starz10de
Hi, no hits are not null, I can print all retrieved docuemtns without problem. -- View this message in context: http://lucene.472066.n3.nabble.com/highlighter-by-using-term-offsets-tp3527712p3533380.html Sent from the Lucene - Java Users mailing list archive at Nabble.com. ---

Re: highlighter by using term offsets

2011-11-23 Thread Ian Lea
I know nothing about highlighting or TermPositionVector, but first step on debugging NPEs on complex lines of code should be to break it down and find out exactly what is causing the exception. Is reader null? hits? Some other problem? -- Ian. On Tue, Nov 22, 2011 at 1:35 PM, starz10de wrote:

Antwort: Re: Re: Highlighter wildcard problems: NoClassDefFoundError in Linux/CentOS 5.4, works in Windows XP

2010-07-30 Thread Markus Roth
@lucene.apache.org 30.07.2010 Kopie 15:51 Thema Re: Re: Highlighter wildcard

Re: Re: Highlighter wildcard problems: NoClassDefFoundError in Linux/CentOS 5.4, works in Windows XP

2010-07-30 Thread Ian Lea
gt; > 30.07.2010 15:39 > Bitte antworten an > java-user@lucene.apache.org > > > An > > java-user@lucene.apache.org > Kopie > > > Thema > > Re: Highlighter wildcard problems: NoClassDefFoundError in Linux/CentOS > 5.4, works in Wi

Antwort: Re: Highlighter wildcard problems: NoClassDefFoundError in Linux/CentOS 5.4, works in Windows XP

2010-07-30 Thread Markus Roth
Thema Re: Highlighter wildcard problems: Bitte NoClassDefFoundError in antworten an Linux/CentOS 5.4, works in

Re: Highlighter wildcard problems: NoClassDefFoundError in Linux/CentOS 5.4, works in Windows XP

2010-07-30 Thread Ian Lea
Your linux set up is evidently missing a jar file - the one that contains org/apache/lucene/index/memory/MemoryIndex. Or it is there but not in the CLASSPATH, or something else along those lines. -- Ian. On Fri, Jul 30, 2010 at 2:30 PM, Markus Roth wrote: > > > Hello everyone, > > I'm using

Re: Highlighter usage

2010-04-29 Thread Justin
t; would I override nextToken() and stem or is there a better way to use > something like SnowballFilter? > > > > > - Original Message > From: Erick Erickson > To: java-user@lucene.apache.org > Sent: Thu, April 29, 2010 3:30:09 PM > Subject: Re: Highlighter

Re: Highlighter usage

2010-04-29 Thread Erick Erickson
oken() and stem or is there a better way to use > something like SnowballFilter? > > > > > - Original Message > From: Erick Erickson > To: java-user@lucene.apache.org > Sent: Thu, April 29, 2010 3:30:09 PM > Subject: Re: Highlighter usage > > What analyzer are

Re: Highlighter usage

2010-04-29 Thread Justin
em or is there a better way to use something like SnowballFilter? - Original Message From: Erick Erickson To: java-user@lucene.apache.org Sent: Thu, April 29, 2010 3:30:09 PM Subject: Re: Highlighter usage What analyzer are you using at index time? My guess is something

Re: Highlighter usage

2010-04-29 Thread Erick Erickson
What analyzer are you using at index time? My guess is something like WhitespaceAnalyzer that doesn't stem or change case. Try a different analyzer, SimpleAnalyzer comes to mind HTH Erick On Thu, Apr 29, 2010 at 4:21 PM, Justin wrote: > I'm trying to use Highlighter with QueryScorer aft

Re: Highlighter / cannot be instantiated

2010-01-29 Thread Illés Solt
Are you sure you imported Highlighter from the correct lucene namespace org.apache.lucene.search.highlight.Highlighter and not something else like javax.swing.text.Highlighter? Illes 2010/1/28 Marc Schwarz : > I'm trying to get the highlighter running, but didn't get it work. > > Everywhere i

Re: Highlighter doesn't highlight wildcard queries after updating to 2.9.1/3.0.0

2010-01-11 Thread Mohsen Saboorian
changing MultiTermRewriteMethod fixed all previous incompatibility issue. After setting this: myQueryParser.setMultiTermRewriteMethod(MultiTermQuery.SCORING_BOOLEAN_QUERY_REWRITE); highlighter get compatible with rewrite, query.rewrite().toString() works as before and scoring works fine for wildc

Re: Highlighter doesn't highlight wildcard queries after updating to 2.9.1/3.0.0

2010-01-10 Thread Mohsen Saboorian
OK, to answer my own question: I found from the following issue that if I do a query.rewrite(), highlighter doesn't work. https://issues.apache.org/jira/browse/LUCENE-1425 I did rewrite() in order to find all matched terms for example in a prefix query, but as this doesn't work anymore like Lucen

Re: Highlighter doesn't highlight wildcard queries after updating to 2.9.1/3.0.0

2010-01-10 Thread Mohsen Saboorian
The problem comes from this method: org.apache.lucene.search.highlight.WeightedSpanTermExtractor.extract(Query, Map) The query passed to this method is of type org.apache.lucene.search.ConstantScoreQuery, but it matches non of 'instanceof' checkings in this method, so no WeightedSpanTerm is extra

Re: Highlighter doesn't highlight wildcard queries after updating to 2.9.1/3.0.0

2009-12-30 Thread Mohsen Saboorian
Yes I can (though I need some time, since I have my nested custom analyzers and filter). I'll try to write a test scenario to reproduce this issue. For now, can you tell me if these steps are correct for instantiating and using highlighter: IndexSearcher is = new IndexSearcher(indexReader); Quer

Re: Highlighter doesn't highlight wildcard queries after updating to 2.9.1/3.0.0

2009-12-30 Thread Mark Miller
Mohsen Saboorian wrote: > After updating to 2.9.x or 3.0, highlighter doesn't work on wildcard queries > like "abc*". I thought that it would be because of scoring, so I also set > myIndexSearcher.setDefaultFieldSortScoring(true, true) before searching. > I tested with both QueryScorer and QueryTer

Re: Highlighter and Phrase Queries

2008-11-10 Thread Mark Miller
Check out the SpanScorer. - Mark On Nov 10, 2008, at 8:25 AM, "Sertic Mirko, Bedag" <[EMAIL PROTECTED] > wrote: [EMAIL PROTECTED] I am searching for a solution to make the Highlighter run property in combination with phrase queries. I want to highlight text with a phrase query like "w

Re: highlighter / fragmenter performance for large fields

2008-10-20 Thread Brian Beard
Karsten, Thanks, I will look into this. >Hi Brian, > >I don't know the internals of highlighting („explanation“) in lucene. >But I know that XTF ( >http://xtf.wiki.sourceforge.net/underHood_Documents#tocunderHood_Documents5 >) can handle very large documents (above 100 Mbyte) with highlighting v

Re: highlighter / fragmenter performance for large fields

2008-10-16 Thread Karsten F.
Hi Brian, I don't know the internals of highlighting („explanation“) in lucene. But I know that XTF ( http://xtf.wiki.sourceforge.net/underHood_Documents#tocunderHood_Documents5 ) can handle very large documents (above 100 Mbyte) with highlighting very fast. The difference to your approach is, th

Re: Highlighter Hits

2008-03-12 Thread Matthew Hall
I suspect you are using a different analyzer to highlight than you are using to search. A couple of things you can check: Immediately after your query simply print out hits.length, this should conclusively tell you that you query is in fact working, after that ensure that you are using the sa

Re: Highlighter Hits

2008-03-12 Thread Erick Erickson
What does your stack trace look like? I've never seen Lucene "just quit" without throwing an exception, and printStackTrace() is your friend. Or are you catching exceptions without logging them? If so, shame on you . Best Erick P.S. I can't recommend strongly enough that you get a good I

Re: Highlighter and href fields

2007-10-24 Thread Cool Coder
Ok I understand now that I have a big work ahead of me. >2. Use an Analyzer that recognizes URL's. That way you wont get partial BTW, Do you know any analyzer that can recognize URLs. - BR Mark Miller <[EMAIL PROTECTED]> wrote: Nothing in the Highlighter per seh that will help you ther

Re: Highlighter and href fields

2007-10-24 Thread Mark Miller
Nothing in the Highlighter per seh that will help you there. I see two options off the top of my head: 1. break the text before feeding it to the highlighter and feed all but the URL parts, and then stitch back together -- much as you might do if highlighting an XML doc. Ugly though. 2. Use

Re: Highlighter that works with phrase and span queries

2007-08-29 Thread Mike Klaas
I just meant whether it would live in a lucene release (somewhere under contrib/) or just in JIRA. Would including the functionality in Solr help get it into lucene? -Mike On 29-Aug-07, at 4:58 AM, Mark Miller wrote: It kind of is a contrib -- its really just a new Scorer class (with som

Re: Highlighter that works with phrase and span queries

2007-08-29 Thread Mark Miller
The patch you refer to should include the javadoc/source code. If that is not sufficient, drop me a line privately and I will email you all of the source code / javadoc. - Mark Michael Stoppelman wrote: Ah, much clearer now. It seems that the jar file is just the class files. Is the source/ja

Re: Highlighter that works with phrase and span queries

2007-08-29 Thread Mark Miller
It kind of is a contrib -- its really just a new Scorer class (with some axillary helper classes) for the old contrib Highlighter. Since the contrib Highlighter is pretty hardened at this point, I figured that was the best way to go. Or do you mean something different? - Mark Mike Klaas wrote

Re: Highlighter that works with phrase and span queries

2007-08-27 Thread Mike Klaas
Mark, I'm still interested in integrating this into Solr--this is a feature that has been requested a few times. It would be easier to do so if it were a contrib/... thanks for the great work, -Mike On 27-Aug-07, at 4:21 AM, Mark Miller wrote: I am a bit unclear about your question. The

Re: Highlighter that works with phrase and span queries

2007-08-27 Thread Michael Stoppelman
Ah, much clearer now. It seems that the jar file is just the class files. Is the source/javadoc code somewhere else? -M On 8/27/07, Mark Miller <[EMAIL PROTECTED]> wrote: > > I am a bit unclear about your question. The patch you mention extends > the original Highlighter to support phrase and spa

Re: Highlighter that works with phrase and span queries

2007-08-27 Thread Mark Miller
I am a bit unclear about your question. The patch you mention extends the original Highlighter to support phrase and span queries. It does not include any major performance increases over the original Highlighter (in fact, it takes a bit longer to Highlight a Span or Phrase query than it does t

Re: Highlighter that works with phrase and span queries

2007-08-27 Thread Michael Stoppelman
Is this jar going to be in the next release of lucene? Also, are these the same as the changes in the following patch: https://issues.apache.org/jira/secure/attachment/12362653/spanhighlighter10.patch -M On 6/27/07, Mark Miller <[EMAIL PROTECTED]> wrote: > > > > I have not looked at any highlight

Re: Highlighter strategy in Lucene

2007-07-26 Thread Mark Miller
There has been a lot of Highlighter discussion on the list. Search the list at nabble or gossamer-threads and you will find a lot of info. - Mark On 7/25/07, Dmitry <[EMAIL PROTECTED]> wrote: Waht kind of Highlighter strategy Lucene is using? thanks, Dt www.ejinz.com Search Engine for News -

Re: Highlighter that works with phrase and span queries

2007-06-27 Thread Mark Miller
I have not looked at any highlighting code yet. Is there already an extension of PhraseQuery that has getSpans() ? Currently I am using this code originally by M. Harwood: Term[] phraseQueryTerms = ((PhraseQuery) query).getTerms(); int i; SpanQuery[] clauses

Re: Highlighter that works with phrase and span queries

2007-06-27 Thread Paul Elschot
On Wednesday 27 June 2007 17:17, mark harwood wrote: > >>you would still have the major problem of which matches do you keep information for > > Yes, doing this efficiently is the main issue. Some vague thoughts I had: >... > 3) For each call to scorer.next() on the top level query, the Highligh

Re: Highlighter that works with phrase and span queries

2007-06-27 Thread mark harwood
h for just these few docs. Cheers Mark - Original Message From: Mark Miller <[EMAIL PROTECTED]> To: java-user@lucene.apache.org Sent: Wednesday, 27 June, 2007 12:59:21 PM Subject: Re: Highlighter that works with phrase and span queries markharw00d wrote: > > I was t

Re: Highlighter that works with phrase and span queries

2007-06-27 Thread Mark Miller
Depending on what these guys are doing, here is another possibility if TermOffests and Ronnie's highlighter are not an option. If you are highlighting whole documents (NullFragmenter) or are not very concerned about the fragments you get back, you can change the line in the Highlighter at abou

Re: Highlighter that works with phrase and span queries

2007-06-27 Thread Mark Miller
markharw00d wrote: I was thinking along the lines of wrapping some core classes such as IndexReader to somehow observe the query matching process and deduce from that what to highlight (avoiding the need for MemoryIndex) but I'm not sure that is viable. It would be nice to get some more ma

Re: Highlighter that works with phrase and span queries

2007-06-22 Thread Otis Gospodnetic
11:19:22 PM Subject: Re: Highlighter that works with phrase and span queries Results of my tests : The new SpanScorer is just about the same speed as the old Highlighter's QueryScorer if the Query contains no position sensitive elements. This is only the case, however, if the CachingTokenF

Re: Highlighter that works with phrase and span queries

2007-06-21 Thread markharw00d
Hi Mark, Good summary. I was running some timings earlier and my results echo your findings. >>I am currently trying to think of some possible hybrid approach to highlighting... I was thinking along the lines of wrapping some core classes such as IndexReader to somehow observe the query mat

Re: Highlighter that works with phrase and span queries

2007-06-21 Thread Mark Miller
From: Mark Miller <[EMAIL PROTECTED]> To: java-user@lucene.apache.org Sent: Thursday, 21 June, 2007 2:11:52 AM Subject: Re: Highlighter that works with phrase and span queries I will work up some performance numbers over the next day or two to share with you. I have spent the last day or

Re: Highlighter that works with phrase and span queries

2007-06-21 Thread mark harwood
ng "helper" interfaces (Fragmenter/Scorer) remains to be seen. Cheers, Mark - Original Message From: Mark Miller <[EMAIL PROTECTED]> To: java-user@lucene.apache.org Sent: Thursday, 21 June, 2007 2:11:52 AM Subject: Re: Highlighter that works with phrase and span queries I wil

Re: Highlighter that works with phrase and span queries

2007-06-20 Thread Mark Miller
I will work up some performance numbers over the next day or two to share with you. I have spent the last day or two with a profiler trying to find the biggest performance drains. Unfortunately, I will probably not be able to squeeze out much more performance than the current Highlighter. When

Re: Highlighter that works with phrase and span queries

2007-06-20 Thread Yonik Seeley
On 6/20/07, Chris Lu <[EMAIL PROTECTED]> wrote: Agree. But I think another reason why highlighting is slow could also be the need to retrieve the document's content, quite likely it's on the hard drive, which usually takes around 10ms for each small document, more for larger document. I'm not

Re: Highlighter that works with phrase and span queries

2007-06-20 Thread Chris Lu
Agree. But I think another reason why highlighting is slow could also be the need to retrieve the document's content, quite likely it's on the hard drive, which usually takes around 10ms for each small document, more for larger document. -- Chris Lu - Instant Scalable Ful

Re: Highlighter that works with phrase and span queries

2007-06-20 Thread Otis Gospodnetic
Hi Mark, I know one large user (meaning: high query/highlight rates) of the current Highlighter and this user wasn't too happy with its performance. I don't know the details, other than it was inefficient. So now I'm wondering if you've benchmarked your Highlighter against that/current Highli

Re: Highlighter that works with phrase and span queries

2007-06-20 Thread Mike Klaas
On 19-Jun-07, at 3:39 PM, Mark Miller wrote: I have been working on extending the Highlighter with a new Scorer that correctly scores phrase and span queries. The highlighter is working great for me, but could really use some more banging on. If you have a need or an interest in a more accu

Re: highlighter highlights another term

2007-04-16 Thread Leos Literak
markharw00d wrote: See the Junit test example for field-sensitive highlighting. If you pass a fieldname to the QueryScorer constructor it only considers query terms for that field - the default without is all fields Thanks for hint, it works :-) --

Re: highlighter highlights another term

2007-04-15 Thread markharw00d
See the Junit test example for field-sensitive highlighting. If you pass a fieldname to the QueryScorer constructor it only considers query terms for that field - the default without is all fields Cheers Mark - To unsubscribe

Re: Highlighter returning incomplete field text

2007-02-09 Thread Erick Erickson
Also, there's a default of 10,000 tokens per field at index time Erick On 2/9/07, mark harwood <[EMAIL PROTECTED]> wrote: See Highlighter.setMaxDocBytesToAnalyze(int byteCount) It's default setting is limited in order to avoid excessive response times. Cheers Mark - Original Messag

Re: Highlighter returning incomplete field text

2007-02-09 Thread mark harwood
See Highlighter.setMaxDocBytesToAnalyze(int byteCount) It's default setting is limited in order to avoid excessive response times. Cheers Mark - Original Message From: Fred Eaker <[EMAIL PROTECTED]> To: java-user@lucene.apache.org Sent: Friday, 9 February, 2007 4:28:36 PM Subject: High

Re: Highlighter

2006-08-16 Thread Mark Miller
The reason has already been posted in response to my initial inquiry. This problem bugged me last month. I did not know the particulars but I assumed it was a bug. I inquired on the mailing list and someone responded with the following link: Highligter fails to include non-token at end of st

Re: Highlighter

2006-08-16 Thread Bill Taylor
[EMAIL PROTECTED] told me that the highlighter ALWAYS does this under certain conditions. In my case, it is when the string ends with . He knew why but I did not. I just fixed it in my code by putting things back. On Aug 16, 2006, at 3:17 AM, Ramesh Salla wrote: which version of Lucene a

Re: Highlighter

2006-08-16 Thread Ramesh Salla
which version of Lucene and which version of Highlighter, do you use. I dont see any such issues? I think,  I can resolve the issue,  if you can pass on a few info on you are trying to get the data and highlight things. On Sat, 2006-08-12 at 00:05 +, Ronnie Kolehmainen wrote: There is

Re: Highlighter

2006-08-11 Thread Ronnie Kolehmainen
There is an issue in JIRA, see http://issues.apache.org/jira/browse/LUCENE-645 So I guess you're not the only one. /Ronnie Citerar Mark Miller <[EMAIL PROTECTED]>: > Am I the only one that gets back a string missing the final character > when using the highlighter and the null fragmenter? I al

Re: Highlighter and complex queries

2006-04-29 Thread markharw00d
Hi Marios. >>Isn't this wrong? Yes but this is an itch that no one has been suffficently been bothered by to fix yet. I still haven't had the time or a desperate need to implement this so it will probably remain that way until someone feels strongly enough about the problem to fix it. Highligh

Re: Highlighter and complex queries

2006-04-29 Thread Erik Hatcher
On Apr 29, 2006, at 1:59 AM, Marios Skounakis wrote: Suppose the user enters the following query using a textbox interface: "rate based optimization" (as a phrase query, including the quotes). The query is parsed using QueryParser, then it is rewritten, and given to the highlighter. Then, m

Re: Highlighter

2006-01-26 Thread msftblows
<[EMAIL PROTECTED]> To: java-user@lucene.apache.org Sent: Tue, 24 Jan 2006 22:43:53 - Subject: RE: Highlighter Yes I think you're right. On reading the "lucene in action" chapted on highlighting I found it squirreled in the middle of the text. I get the feeling that whilst I ha

Re: Highlighter

2006-01-25 Thread Erik Hatcher
On Jan 25, 2006, at 6:39 AM, Gwyn Carwardine wrote: Yes I think you're right. On reading the "lucene in action" chapted on highlighting I found it squirreled in the middle of the text. I get the feeling that whilst I have so far found query parser to be the primary method of building queri

RE: Highlighter

2006-01-25 Thread Gwyn Carwardine
>> Yes I think you're right. On reading the "lucene in action" chapted on >> highlighting I found it squirreled in the middle of the text. I get >> the >> feeling that whilst I have so far found query parser to be the primary >> method of building queries that this is not ht eprimary method used

Re: Highlighter

2006-01-25 Thread Erik Hatcher
On Jan 24, 2006, at 5:43 PM, Gwyn Carwardine wrote: Yes I think you're right. On reading the "lucene in action" chapted on highlighting I found it squirreled in the middle of the text. I get the feeling that whilst I have so far found query parser to be the primary method of building queries

Re: Highlighter

2006-01-25 Thread Erik Hatcher
On Jan 25, 2006, at 12:50 AM, Ravi wrote: I am also have some problem with highlighter when I want to highlight specific field in the lucene it is not working Improvements were made to the Highlighter in December to add field- specific highlighting capability. Here's the svn log: -

RE: Highlighter

2006-01-24 Thread Ravi
@lucene.apache.org Subject: RE: Highlighter I've never used .net port of Lucene and highlighter, but I believe we have to call Query.rewrite() to expand the query expression when using phrasequery, wildcardquery, regexquery and fuzzyquery, then pass it to highlighter. hope this helps,

RE: Highlighter

2006-01-24 Thread Gwyn Carwardine
anuary 2006 22:23 To: java-user@lucene.apache.org Subject: RE: Highlighter I've never used .net port of Lucene and highlighter, but I believe we have to call Query.rewrite() to expand the query expression when using phrasequery, wildcardquery, regexquery and fuzzyquery, then pass it to high

RE: Highlighter

2006-01-24 Thread Koji Sekiguchi
I've never used .net port of Lucene and highlighter, but I believe we have to call Query.rewrite() to expand the query expression when using phrasequery, wildcardquery, regexquery and fuzzyquery, then pass it to highlighter. hope this helps, Koji > -Original Message- > From: Gwyn Carwar

Re: Highlighter

2005-12-28 Thread Erik Hatcher
The Highlighter class is not in the core of Lucene. When 1.4.3 was released, the add-ons such as the Highlighter were in a separate CVS repository called "sandbox". When we moved to Subversion we put it all together and it is now under a directory called contrib/highlighter. To have a Hig

Re: Highlighter, Term Positions and Stopwords

2005-12-06 Thread Erik Hatcher
On Dec 5, 2005, at 11:32 PM, Dan Climan wrote: Do stopfilters create non-contiguous token positions? No, not currently. StopFilter leaves token positions in their original state, which defaults to contiguous (offset of 1). There is an open issue to change this behavior though, and at one

Re: Highlighter for 1.4.3?

2005-10-30 Thread Erik Hatcher
On 31 Oct 2005, at 01:07, J Jensen wrote: I got the LuceneInAction.zip, extracted the highlighter-dev.jar and added it to the my classpath. I tried to Test the jar with this code from the LIA... String string = "The quick brown fox jumps over the lazy dog"; TermQuery termQuery = new TermQ

Re: Highlighter for Lucene 1.4.3?

2005-10-30 Thread Erik Hatcher
What's the issue with using the one from the LIA source code?It is compatible with Lucene 1.4.3 and all the code successfully compiles and all tests pass from there, right? Erik On 30 Oct 2005, at 12:28, J Jensen wrote: Can anyone provide me with a Highlighter.jar file that can be

RE: Highlighter apply to Japanese

2005-09-06 Thread Koji Sekiguchi
> Sent: Tuesday, September 06, 2005 7:22 PM > To: java-user@lucene.apache.org > Subject: RE: Highlighter apply to Japanese > > > Try change TokenGroup.isDistinct(); > > Maybe the offset test code should be >= rather than > > ie > > boolean isDistinct(

RE: Highlighter apply to Japanese

2005-09-06 Thread mark harwood
Try change TokenGroup.isDistinct(); Maybe the offset test code should be >= rather than > ie boolean isDistinct(Token token) { return token.startOffset()>=endOffset; } I've just tried the change with the Junit test and all seems well still with the non CJK

RE: Highlighter apply to Japanese

2005-09-06 Thread Koji Sekiguchi
overlapped as I showed in my previous mail. BTW, I couldn't find CJKHighlighter and CJKHighlighterAnalyzer in sandbox... Koji > -Original Message- > From: Chris Lu [mailto:[EMAIL PROTECTED] > Sent: Tuesday, September 06, 2005 3:53 PM > To: java-user@lucene.apache.

RE: Highlighter apply to Japanese

2005-09-06 Thread Koji Sekiguchi
tokens to me. Any thoughts? Koji > -Original Message- > From: markharw00d [mailto:[EMAIL PROTECTED] > Sent: Tuesday, September 06, 2005 3:37 PM > To: java-user@lucene.apache.org > Subject: Re: Highlighter apply to Japanese > > > I don't know the behaviour

Re: Highlighter apply to Japanese

2005-09-05 Thread Chris Lu
Hi, Koji, I had the same problem as you. This is because CJK's n-gram analysis is different from single character's. My get around is to use CJKHighlighter and CJKHighlightAnalyzer in sandbox. -- Chris Lu Lucene Search RAD on Any Database http://www.dbsight.net On 9/5/05, Koji Se

Re: Highlighter apply to Japanese

2005-09-05 Thread markharw00d
I don't know the behaviour of the Japanese Analyzer you are using. Can you add to your example diagnosis the Token.getPositionIncrement, Token.startOffset and Token.endOffset for each of the tokens? The highlighter groups tokens with overlapping start and end offsets into a single TokenGroup f

Re: highlighter to use with 1.4.3?

2005-07-05 Thread Erik Hatcher
On Jul 5, 2005, at 4:48 PM, Leos Literak wrote: Hi, I'd like to play around with highlighter. I downloaded one from sandbox, but it doesn't compile against lucene stable 1.4.3. highlight/TokenSources.java:19: cannot find symbol [javac] symbol : class TermVectorOffsetInfo Is there some p

Re: Highlighter for CJK ??

2005-04-14 Thread mark harwood
Hi Eric, I haven't tested it personally, but I have had reports that it works OK with CJKAnalyzer. This was reported after I added support for overlapping tokens in tokenstreams last July. Cheers, Mark --- Eric Chow <[EMAIL PROTECTED]> wrote: > Hello, > > Is any any good Highlighter for Asian

Re: Highlighter for CJK ??

2005-04-14 Thread Che Dong
Here is a demo: http://grassland.cnblog.org/ Che Dong Eric Chow åé: Hello, Is any any good Highlighter for Asian languages (Chinese, Japanese, Koreanese) Eric - To unsubscribe, e-mail: [EMAIL PROTECTED] For additional commands, e-m

Re: Highlighter compile error

2005-03-10 Thread Otis Gospodnetic
Andy, Judging from your path, it looks like you didn't check things out of SVN. You'll need a SVN client, and then you could: svn co http://svn.apache.org/repos/asf/lucene/java/trunk/ In there you will see a contrib/ directory, and highlighter underneath it. Running ant from there builds the

Re: highlighter and phrase search

2005-03-10 Thread markharw00d
The short answer is "no", there is not support for this currently. Implementing this support is possible but fiddly- there is a related discussion here which outlines some of the challenges : http://www.mail-archive.com/lucene-user@jakarta.apache.org/msg12435.html Cheers, Mark --