[jira] Resolved: (LUCENE-1775) Change org.apache.lucene.analysis.shingle to use new TokenStream API

2009-08-02 Thread Michael Busch (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1775?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Busch resolved LUCENE-1775. --- Resolution: Fixed Committed revision 800195. > Change org.apache.lucene.analysis.shingle to

[jira] Resolved: (LUCENE-1486) Wildcards, ORs etc inside Phrase queries

2009-08-02 Thread Mark Miller (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1486?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mark Miller resolved LUCENE-1486. - Resolution: Fixed > Wildcards, ORs etc inside Phrase queries > -

[jira] Commented: (LUCENE-1748) getPayloadSpans on org.apache.lucene.search.spans.SpanQuery should be abstract

2009-08-02 Thread Mark Miller (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1748?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12738183#action_12738183 ] Mark Miller commented on LUCENE-1748: - I'm going to commit this to the backcompat bran

[jira] Resolved: (LUCENE-1567) New flexible query parser

2009-08-02 Thread Michael Busch (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1567?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Busch resolved LUCENE-1567. --- Resolution: Fixed Committed revision 800191. Thank you very much, Adriano and Luis, for all

[jira] Updated: (LUCENE-1685) Make the Highlighter use SpanScorer by default

2009-08-02 Thread Mark Miller (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1685?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mark Miller updated LUCENE-1685: Attachment: LUCENE-1685.patch Changed the constructors for QueryScorer to more closely match what

[jira] Created: (LUCENE-1777) Error on distance query where miles < 1.0

2009-08-02 Thread Glen Stampoultzis (JIRA)
Error on distance query where miles < 1.0 - Key: LUCENE-1777 URL: https://issues.apache.org/jira/browse/LUCENE-1777 Project: Lucene - Java Issue Type: Bug Components: contrib/spatial

[jira] Updated: (LUCENE-1777) Error on distance query where miles < 1.0

2009-08-02 Thread Glen Stampoultzis (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1777?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Glen Stampoultzis updated LUCENE-1777: -- Affects Version/s: 2.9 > Error on distance query where miles < 1.0 > -

[jira] Updated: (LUCENE-1685) Make the Highlighter use SpanScorer by default

2009-08-02 Thread Mark Miller (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1685?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mark Miller updated LUCENE-1685: Attachment: LUCENE-1685.patch Another rev making things a little easier. QueryScorer now takes a

[jira] Commented: (LUCENE-1749) FieldCache introspection API

2009-08-02 Thread Yonik Seeley (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1749?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12738140#action_12738140 ] Yonik Seeley commented on LUCENE-1749: -- bq. It's interesting that we didn't (I think?

[jira] Created: (LUCENE-1776) NearSpansOrdered does not lazy load payloads as the PayloadSpans javadoc implies

2009-08-02 Thread Mark Miller (JIRA)
NearSpansOrdered does not lazy load payloads as the PayloadSpans javadoc implies Key: LUCENE-1776 URL: https://issues.apache.org/jira/browse/LUCENE-1776 Project: Lucene -

Re: TestIndexWriter failure

2009-08-02 Thread Shai Erera
Thanks Mike for the clarification. Almost all merge methods are synced on IndexWriter, except for mergeMiddle. So it is possible that you call abort, after the merge thread has already checked if the merge was aborted ... Maybe if we do: sync (this) { merge.checkAborted(directory); new Segmen

Re: IndexWriter.getReader usage

2009-08-02 Thread Michael McCandless
It's likely the RAMDir approach will still be a performance win over getReader, until LUCENE-1313 is in (which uses a RAMDir for the small-enough newly flushed segments). getReader() writes (but doesn't sync) the new segment files to the Directory, and then opens a new SegmentReader on those files

[jira] Assigned: (LUCENE-1773) Add benchmark task for FastVectorHighlighter

2009-08-02 Thread Michael McCandless (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1773?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael McCandless reassigned LUCENE-1773: -- Assignee: Michael McCandless > Add benchmark task for FastVectorHighlighter >

[jira] Commented: (LUCENE-1774) In a benchmark alg, if you use a log.step thats higher than the number of docs you add, whacky high numbers are logged for doc adds

2009-08-02 Thread Shai Erera (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1774?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12738109#action_12738109 ] Shai Erera commented on LUCENE-1774: That is indeed new (I added it in LUCENE-1595 as

[jira] Resolved: (LUCENE-1522) another highlighter

2009-08-02 Thread Michael McCandless (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael McCandless resolved LUCENE-1522. Resolution: Fixed > another highlighter > --- > >

[jira] Reopened: (LUCENE-1522) another highlighter

2009-08-02 Thread Michael McCandless (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael McCandless reopened LUCENE-1522: Thanks Koji, I'll commit this (turning on the tests). Always nice to add more tests!

[jira] Resolved: (LUCENE-1764) SampleComparable doesn't work well in contrib/remote tests

2009-08-02 Thread Mark Miller (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1764?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mark Miller resolved LUCENE-1764. - Resolution: Fixed > SampleComparable doesn't work well in contrib/remote tests > ---

Re: TestIndexWriter failure

2009-08-02 Thread Michael McCandless
The exceptions aren't expected. When you call IndexWriter.close(false), it's supposed to notify all running merges to abort, wait until they in fact do stop, and then return. But it looks as if there's a silly thread hazard, whereby IndexWriter believes all merges have aborted, but in fact those

[jira] Updated: (LUCENE-1771) Using explain may double ram reqs for fieldcaches when using ValueSourceQuery/CustomScoreQuery or for ConstantScoreQuerys that use a caching Filter.

2009-08-02 Thread Mark Miller (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mark Miller updated LUCENE-1771: Attachment: LUCENE-1771.patch Current state of fix (being iterated on in the fieldcache introspect

[jira] Commented: (LUCENE-1749) FieldCache introspection API

2009-08-02 Thread Michael McCandless (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1749?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12738100#action_12738100 ] Michael McCandless commented on LUCENE-1749: bq. That was my first thought...

[jira] Resolved: (LUCENE-1774) In a benchmark alg, if you use a log.step thats higher than the number of docs you add, whacky high numbers are logged for doc adds

2009-08-02 Thread Mark Miller (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mark Miller resolved LUCENE-1774. - Resolution: Invalid My fault - had 50k search task that was doing the logging. I don't know if

[jira] Commented: (LUCENE-1774) In a benchmark alg, if you use a log.step thats higher than the number of docs you add, whacky high numbers are logged for doc adds

2009-08-02 Thread Shai Erera (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1774?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12738090#action_12738090 ] Shai Erera commented on LUCENE-1774: strange. I've tried to reproduce but failed, so i

[jira] Issue Comment Edited: (LUCENE-1759) Implement TokenStream.end() in contrib TokenStreams

2009-08-02 Thread Mark Miller (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1759?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12738081#action_12738081 ] Mark Miller edited comment on LUCENE-1759 at 8/2/09 7:46 AM: -

[jira] Commented: (LUCENE-1759) Implement TokenStream.end() in contrib TokenStreams

2009-08-02 Thread Mark Miller (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1759?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12738081#action_12738081 ] Mark Miller commented on LUCENE-1759: - bq. In this particular case it's used to fix th

[jira] Commented: (LUCENE-1774) In a benchmark alg, if you use a log.step thats higher than the number of docs you add, whacky high numbers are logged for doc adds

2009-08-02 Thread Mark Miller (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1774?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12738077#action_12738077 ] Mark Miller commented on LUCENE-1774: - Yeah, I'll post some further info when I get a

[jira] Issue Comment Edited: (LUCENE-1768) NumericRange support for new query parser

2009-08-02 Thread Uwe Schindler (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12738052#action_12738052 ] Uwe Schindler edited comment on LUCENE-1768 at 8/2/09 5:10 AM: -

[jira] Commented: (LUCENE-1768) NumericRange support for new query parser

2009-08-02 Thread Uwe Schindler (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12738052#action_12738052 ] Uwe Schindler commented on LUCENE-1768: --- Luis, I will post an example of queries and

Re: TestIndexWriter failure

2009-08-02 Thread Shai Erera
Isn't this expected? I mean, if you close IndexWriter, but there are merges run in the background, aren't they expected to hit an AlreadyClosedException? Perhaps we should fix the test to check whether CMS hit this exception and if so clear it (as AFAIU, it's expected), and leave any other excepti

[jira] Commented: (LUCENE-1774) In a benchmark alg, if you use a log.step thats higher than the number of docs you add, whacky high numbers are logged for doc adds

2009-08-02 Thread Shai Erera (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1774?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12738033#action_12738033 ] Shai Erera commented on LUCENE-1774: Mark - can you perhaps paste here an .alg file an

[jira] Commented: (LUCENE-1775) Change org.apache.lucene.analysis.shingle to use new TokenStream API

2009-08-02 Thread Michael Busch (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1775?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12738029#action_12738029 ] Michael Busch commented on LUCENE-1775: --- Hi Uwe, I just noticed your comment after

[jira] Updated: (LUCENE-1775) Change org.apache.lucene.analysis.shingle to use new TokenStream API

2009-08-02 Thread Michael Busch (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1775?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Busch updated LUCENE-1775: -- Attachment: lucene-1775.patch I noticed that a shingle test uses PrefixAndSuffixAwareTokenFilt

[jira] Commented: (LUCENE-1504) SerialChainFilter should use DocSet API rather then deprecated BitSet API

2009-08-02 Thread Uwe Schindler (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12738027#action_12738027 ] Uwe Schindler commented on LUCENE-1504: --- I had no time to review the whole patch yet

[jira] Commented: (LUCENE-1775) Change org.apache.lucene.analysis.shingle to use new TokenStream API

2009-08-02 Thread Uwe Schindler (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1775?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12738026#action_12738026 ] Uwe Schindler commented on LUCENE-1775: --- This ShingleMatrixFilter is really a pain!

[jira] Commented: (LUCENE-1775) Change org.apache.lucene.analysis.shingle to use new TokenStream API

2009-08-02 Thread Michael Busch (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1775?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12738022#action_12738022 ] Michael Busch commented on LUCENE-1775: --- I'll commit this in a couple of days if nob

[jira] Updated: (LUCENE-1775) Change org.apache.lucene.analysis.shingle to use new TokenStream API

2009-08-02 Thread Michael Busch (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1775?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Busch updated LUCENE-1775: -- Attachment: lucene-1775.patch ShingleMatrixFilter is a very complicated filter. It seems that

[jira] Commented: (LUCENE-1460) Change all contrib TokenStreams/Filters to use the new TokenStream API

2009-08-02 Thread Uwe Schindler (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1460?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12738019#action_12738019 ] Uwe Schindler commented on LUCENE-1460: --- You two guys are the best, great work! I ha

[jira] Updated: (LUCENE-1775) Change org.apache.lucene.analysis.shingle to use new TokenStream API

2009-08-02 Thread Michael Busch (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1775?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Busch updated LUCENE-1775: -- Attachment: lucene-1775.patch Converted TestShingleMatrixFilter. Not the actual filter yet. >

[jira] Updated: (LUCENE-1775) Change org.apache.lucene.analysis.shingle to use new TokenStream API

2009-08-02 Thread Michael Busch (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1775?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Busch updated LUCENE-1775: -- Attachment: lucene-1775.patch First half is done: ShingleFilter and ShingleFilterTest are conv