[jira] Commented: (LUCENE-504) FuzzyQuery produces a "java.lang.NegativeArraySizeException" in PriorityQueue.initialize if I use Integer.MAX_VALUE as BooleanQuery.MaxClauseCount

2006-06-11 Thread Doron Cohen (JIRA)
[ http://issues.apache.org/jira/browse/LUCENE-504?page=comments#action_12415800 ] Doron Cohen commented on LUCENE-504: LuceneFAQ item"Why am I getting a TooManyClauses exception?" suggests:"use BooleanQuery.setMaxClauseCount(Integer.MAX_VALUE)

[jira] Updated: (LUCENE-504) FuzzyQuery produces a "java.lang.NegativeArraySizeException" in PriorityQueue.initialize if I use Integer.MAX_VALUE as BooleanQuery.MaxClauseCount

2006-06-11 Thread Doron Cohen (JIRA)
[ http://issues.apache.org/jira/browse/LUCENE-504?page=all ] Doron Cohen updated LUCENE-504: --- Attachment: BooleanQuery.java.diff PriorityQueue.java.diff > FuzzyQuery produces a "java.lang.NegativeArraySizeException" in > PriorityQueue.init

[jira] Commented: (LUCENE-504) FuzzyQuery produces a "java.lang.NegativeArraySizeException" in PriorityQueue.initialize if I use Integer.MAX_VALUE as BooleanQuery.MaxClauseCount

2006-06-12 Thread Doron Cohen (JIRA)
[ http://issues.apache.org/jira/browse/LUCENE-504?page=comments#action_12415825 ] Doron Cohen commented on LUCENE-504: Yes this is correct - e.g. on a win32 machine with 2GB RAM, SUN 1.5 JRE would accept up to Xmx1470m and in that case you could set the

[jira] Commented: (LUCENE-504) FuzzyQuery produces a "java.lang.NegativeArraySizeException" in PriorityQueue.initialize if I use Integer.MAX_VALUE as BooleanQuery.MaxClauseCount

2006-07-06 Thread Doron Cohen (JIRA)
[ http://issues.apache.org/jira/browse/LUCENE-504?page=comments#action_12419624 ] Doron Cohen commented on LUCENE-504: I think it makes sense to separate here between efficiency and correctness. The proposed fix above deals with efficiency, and maybe it

[jira] Commented: (LUCENE-565) Supporting deleteDocuments in IndexWriter (Code and Performance Results Provided)

2006-08-14 Thread Doron Cohen (JIRA)
[ http://issues.apache.org/jira/browse/LUCENE-565?page=comments#action_12428035 ] Doron Cohen commented on LUCENE-565: I tried out this patch (July18), and have a few comments... First, it is nice to be able to add/remove documents with no n

[jira] Updated: (LUCENE-388) [PATCH] IndexWriter.maybeMergeSegments() takes lots of CPU resources

2006-08-16 Thread Doron Cohen (JIRA)
[ http://issues.apache.org/jira/browse/LUCENE-388?page=all ] Doron Cohen updated LUCENE-388: --- Attachment: doron_IndexWriter.patch It seems that the excessive cpu usage is mainly for (re)scanning those single-doc segments at the top of the "stack". The f

[jira] Commented: (LUCENE-388) [PATCH] IndexWriter.maybeMergeSegments() takes lots of CPU resources

2006-08-18 Thread Doron Cohen (JIRA)
[ http://issues.apache.org/jira/browse/LUCENE-388?page=comments#action_12428953 ] Doron Cohen commented on LUCENE-388: well there is a problem in the current patch after all... the counter is not decremented when a merge is triggerred b

[jira] Commented: (LUCENE-650) NPE doing local sensitive sorting when sort field is missing

2006-08-18 Thread Doron Cohen (JIRA)
[ http://issues.apache.org/jira/browse/LUCENE-650?page=comments#action_12428955 ] Doron Cohen commented on LUCENE-650: I reviewed this patch and think that it is valid. This seems like a real bug: - In FieldSortedHitQueue, when no locale is

[jira] Updated: (LUCENE-388) [PATCH] IndexWriter.maybeMergeSegments() takes lots of CPU resources

2006-08-18 Thread Doron Cohen (JIRA)
[ http://issues.apache.org/jira/browse/LUCENE-388?page=all ] Doron Cohen updated LUCENE-388: --- Attachment: doron_2_IndexWriter.patch The attached doron_2_IndexWriter.patch is fixing the updating of singleDocSegmentsCount to take place in mergeSegments(minS

[jira] Updated: (LUCENE-388) [PATCH] IndexWriter.maybeMergeSegments() takes lots of CPU resources

2006-08-18 Thread Doron Cohen (JIRA)
[ http://issues.apache.org/jira/browse/LUCENE-388?page=all ] Doron Cohen updated LUCENE-388: --- Attachment: doron_2b_IndexWriter.patch Right... actually it should be like this: int minSegment = segmentInfos.size() - singleDocSegmentsCount - 1; But sinc

[jira] Commented: (LUCENE-388) [PATCH] IndexWriter.maybeMergeSegments() takes lots of CPU resources

2006-08-20 Thread Doron Cohen (JIRA)
[ http://issues.apache.org/jira/browse/LUCENE-388?page=comments#action_12429248 ] Doron Cohen commented on LUCENE-388: Paul, would you like to re-open this issue for (re)solving it with one of the two recent patches (2 or 2b) - I think that

[jira] Commented: (LUCENE-388) [PATCH] IndexWriter.maybeMergeSegments() takes lots of CPU resources

2006-08-21 Thread Doron Cohen (JIRA)
[ http://issues.apache.org/jira/browse/LUCENE-388?page=comments#action_12429522 ] Doron Cohen commented on LUCENE-388: Oh - sorry for the 'noise' - got used to systems where a commit must be attached to an issue/defect - should have checked

[jira] Created: (LUCENE-665) temporary file access denied on Windows

2006-08-25 Thread Doron Cohen (JIRA)
temporary file access denied on Windows --- Key: LUCENE-665 URL: http://issues.apache.org/jira/browse/LUCENE-665 Project: Lucene - Java Issue Type: Bug Components: Store Affects Versions: 2.0

[jira] Updated: (LUCENE-565) Supporting deleteDocuments in IndexWriter (Code and Performance Results Provided)

2006-08-25 Thread Doron Cohen (JIRA)
[ http://issues.apache.org/jira/browse/LUCENE-565?page=all ] Doron Cohen updated LUCENE-565: --- Attachment: TestBufferedDeletesPerf.java perf-test-res.JPG perfres.log I ran a performance test for interleaved adds and removes -

[jira] Commented: (LUCENE-665) temporary file access denied on Windows

2006-08-27 Thread Doron Cohen (JIRA)
[ http://issues.apache.org/jira/browse/LUCENE-665?page=comments#action_12430919 ] Doron Cohen commented on LUCENE-665: > just to confirm, is it the COMMIT lock that's throwing these > unhandled exceptions (not the WRITE lock)? > If so, lock

[jira] Commented: (LUCENE-665) temporary file access denied on Windows

2006-08-28 Thread Doron Cohen (JIRA)
[ http://issues.apache.org/jira/browse/LUCENE-665?page=comments#action_12430942 ] Doron Cohen commented on LUCENE-665: Stopping the anti-virus and its friends did not matter - still getting the errors. However saw a case that the 30ms did no

[jira] Commented: (LUCENE-665) temporary file access denied on Windows

2006-08-28 Thread Doron Cohen (JIRA)
[ http://issues.apache.org/jira/browse/LUCENE-665?page=comments#action_12431100 ] Doron Cohen commented on LUCENE-665: > obtain() is supposed to return success or failure immediately. > I'd be tempted to override obtain(timout) for FS locks

[jira] Commented: (LUCENE-635) [PATCH] Decouple locking implementation from Directory implementation

2006-08-29 Thread Doron Cohen (JIRA)
[ http://issues.apache.org/jira/browse/LUCENE-635?page=comments#action_12431341 ] Doron Cohen commented on LUCENE-635: While updating my patch for 665 according the changes here, I noticed something - I may be wrong here - but it seems to me

[jira] Commented: (LUCENE-565) Supporting deleteDocuments in IndexWriter (Code and Performance Results Provided)

2006-08-29 Thread Doron Cohen (JIRA)
[ http://issues.apache.org/jira/browse/LUCENE-565?page=comments#action_12431354 ] Doron Cohen commented on LUCENE-565: Is it that results that were returned are suddenly (say after updates) not returned anymore (indicating something bad happ

[jira] Commented: (LUCENE-565) Supporting deleteDocuments in IndexWriter (Code and Performance Results Provided)

2006-08-29 Thread Doron Cohen (JIRA)
[ http://issues.apache.org/jira/browse/LUCENE-565?page=comments#action_12431419 ] Doron Cohen commented on LUCENE-565: Just to make sure on the scenario - are you - (1) using NewIndexModifier at all, or (2) just letting Solr use this IndexW

[jira] Updated: (LUCENE-665) temporary file access denied on Windows

2006-08-29 Thread Doron Cohen (JIRA)
[ http://issues.apache.org/jira/browse/LUCENE-665?page=all ] Doron Cohen updated LUCENE-665: --- Attachment: FSDirs_Retry_Logic_3.patch I am attaching an updated patch - FSDirs_Retry_Logic_3.patch. In this update: - merge with code changes by issue 635 ("de

[jira] Commented: (LUCENE-635) [PATCH] Decouple locking implementation from Directory implementation

2006-08-30 Thread Doron Cohen (JIRA)
[ http://issues.apache.org/jira/browse/LUCENE-635?page=comments#action_12431666 ] Doron Cohen commented on LUCENE-635: > We could (as you're suggesting) indeed extend FSDirectory so that it > provided the low level methods required by a lock

[jira] Commented: (LUCENE-665) temporary file access denied on Windows

2006-08-30 Thread Doron Cohen (JIRA)
[ http://issues.apache.org/jira/browse/LUCENE-665?page=comments#action_12431801 ] Doron Cohen commented on LUCENE-665: I think I know which software is causing/exposing this behavior in my environment. This is the SVN client I am using - Tor

[jira] Updated: (LUCENE-565) Supporting deleteDocuments in IndexWriter (Code and Performance Results Provided)

2006-08-31 Thread Doron Cohen (JIRA)
[ http://issues.apache.org/jira/browse/LUCENE-565?page=all ] Doron Cohen updated LUCENE-565: --- Attachment: perf-test-res2.JPG Updated performance test results - perf-test-res2.JPG - in avarage, the new code is *9* times faster! What have changed? - in p

[jira] Commented: (LUCENE-565) Supporting deleteDocuments in IndexWriter (Code and Performance Results Provided)

2006-09-01 Thread Doron Cohen (JIRA)
[ http://issues.apache.org/jira/browse/LUCENE-565?page=comments#action_12432216 ] Doron Cohen commented on LUCENE-565: I agree - I also suspected it might change the merge behavior (and also had reflections from the repeated trials to have t

[jira] Commented: (LUCENE-665) temporary file access denied on Windows

2006-09-18 Thread Doron Cohen (JIRA)
[ http://issues.apache.org/jira/browse/LUCENE-665?page=comments#action_12435414 ] Doron Cohen commented on LUCENE-665: My summary - and "what's next" proposal - for the discussion so far (in comments for issue-665 and in thread http://www.n

[jira] Updated: (LUCENE-665) temporary file access denied on Windows

2006-09-20 Thread Doron Cohen (JIRA)
[ http://issues.apache.org/jira/browse/LUCENE-665?page=all ] Doron Cohen updated LUCENE-665: --- Attachment: FSWinDirectory.patch Attached patch - FSWinDirectory - implements retry logic of FS operations in a separate non default directory class as discussed

[jira] Commented: (LUCENE-675) Lucene benchmark: objective performance test for Lucene

2006-09-22 Thread Doron Cohen (JIRA)
[ http://issues.apache.org/jira/browse/LUCENE-675?page=comments#action_12436980 ] Doron Cohen commented on LUCENE-675: Few things that would be nice to have in this performance package/framework - () indexing only overall time. () indexing

[jira] Updated: (LUCENE-665) temporary file access denied on Windows

2006-09-26 Thread Doron Cohen (JIRA)
[ http://issues.apache.org/jira/browse/LUCENE-665?page=all ] Doron Cohen updated LUCENE-665: --- Attachment: FSWinDirectory_26_Sep_06.patch Updated the patch according to review comments by Hoss, plus: - protect currMillis usage from system clock modification

[jira] Updated: (LUCENE-664) [PATCH] small fixes to the new scoring.html doc

2006-09-28 Thread Doron Cohen (JIRA)
[ http://issues.apache.org/jira/browse/LUCENE-664?page=all ] Doron Cohen updated LUCENE-664: --- Attachment: boosts_plus_scoring_formula.patch (1) added a section in Scoring.xml for "Search Results Boosts", on ways to boost in Lucene, at search time and at i

[jira] Commented: (LUCENE-664) [PATCH] small fixes to the new scoring.html doc

2006-09-29 Thread Doron Cohen (JIRA)
[ http://issues.apache.org/jira/browse/LUCENE-664?page=comments#action_12438854 ] Doron Cohen commented on LUCENE-664: Hi Grant, For part 1, I am ok with having it after the scoring formula. For part 2, my motivation was to make it more cl

[jira] Commented: (LUCENE-664) [PATCH] small fixes to the new scoring.html doc

2006-10-02 Thread Doron Cohen (JIRA)
[ http://issues.apache.org/jira/browse/LUCENE-664?page=comments#action_12439370 ] Doron Cohen commented on LUCENE-664: Two quick questions: > I think 'norm' is a good term for the product of lengthNorm(d) and > field boost. That's what it i

[jira] Commented: (LUCENE-664) [PATCH] small fixes to the new scoring.html doc

2006-10-06 Thread Doron Cohen (JIRA)
[ http://issues.apache.org/jira/browse/LUCENE-664?page=comments#action_12440592 ] Doron Cohen commented on LUCENE-664: Going to work on this now, according to comments by Doug and Grant. Will give a try to the include idea - client side ifra

[jira] Commented: (LUCENE-664) [PATCH] small fixes to the new scoring.html doc

2006-10-06 Thread Doron Cohen (JIRA)
[ http://issues.apache.org/jira/browse/LUCENE-664?page=comments#action_12440648 ] Doron Cohen commented on LUCENE-664: I played with including the formula from a separate file, Client Side Include. === Summary === I think the "include" is

[jira] Updated: (LUCENE-664) [PATCH] small fixes to the new scoring.html doc

2006-10-07 Thread Doron Cohen (JIRA)
[ http://issues.apache.org/jira/browse/LUCENE-664?page=all ] Doron Cohen updated LUCENE-664: --- Attachment: scoring_formula_2.patch I am attaching scoring_formula_2.patch - modifed scoring formula as suggested. Additional changes here: - order of the expla

[jira] Commented: (LUCENE-664) [PATCH] small fixes to the new scoring.html doc

2006-10-10 Thread Doron Cohen (JIRA)
[ http://issues.apache.org/jira/browse/LUCENE-664?page=comments#action_12441194 ] Doron Cohen commented on LUCENE-664: One comment for Scoring.html: Tthe last sentence in the "Score Boosting" paragraph says: "At scoring (search) time,

[jira] Commented: (LUCENE-664) [PATCH] small fixes to the new scoring.html doc

2006-10-10 Thread Doron Cohen (JIRA)
[ http://issues.apache.org/jira/browse/LUCENE-664?page=comments#action_12441280 ] Doron Cohen commented on LUCENE-664: I just noticed that the link to "TermScorer" in "Understanding the Scoring Formula" is broken b/c TermScorer has package v

[jira] Commented: (LUCENE-678) [PATCH] LockFactory implementation based on OS native locks (java.nio.*)

2006-10-18 Thread Doron Cohen (JIRA)
[ http://issues.apache.org/jira/browse/LUCENE-678?page=comments#action_12443304 ] Doron Cohen commented on LUCENE-678: The patch added a call to "writer.close()" in TestLockFactory - testFSDirectoryTwoCreates(). This is just before the 2nd a

[jira] Commented: (LUCENE-678) [PATCH] LockFactory implementation based on OS native locks (java.nio.*)

2006-10-18 Thread Doron Cohen (JIRA)
[ http://issues.apache.org/jira/browse/LUCENE-678?page=comments#action_1244 ] Doron Cohen commented on LUCENE-678: Michael, I must be misunderstanding something then... > That test case is verifying that the 2nd index writer indeed remov

[jira] Commented: (LUCENE-686) Resources not always reclaimed in scorers after each search

2006-10-25 Thread Doron Cohen (JIRA)
[ http://issues.apache.org/jira/browse/LUCENE-686?page=comments#action_12444742 ] Doron Cohen commented on LUCENE-686: An example of how current Lucene code relies on not having to close resoures, in PhraseQuery: ... scorer(IndexRead

[jira] Commented: (LUCENE-697) Scorer.skipTo affects sloppyPhrase scoring

2006-10-25 Thread Doron Cohen (JIRA)
[ http://issues.apache.org/jira/browse/LUCENE-697?page=comments#action_12444744 ] Doron Cohen commented on LUCENE-697: I can reproduce this by uncommenting this line. Interesting to notice that: (1) the sequence to next() next() skip() ski

[jira] Assigned: (LUCENE-697) Scorer.skipTo affects sloppyPhrase scoring

2006-10-25 Thread Doron Cohen (JIRA)
[ http://issues.apache.org/jira/browse/LUCENE-697?page=all ] Doron Cohen reassigned LUCENE-697: -- Assignee: Doron Cohen > Scorer.skipTo affects sloppyPhrase scoring > -- > > Key: LUCENE-697 >

[jira] Commented: (LUCENE-569) NearSpans skipTo bug

2006-10-27 Thread Doron Cohen (JIRA)
[ http://issues.apache.org/jira/browse/LUCENE-569?page=comments#action_12445284 ] Doron Cohen commented on LUCENE-569: It seems that having "assert()" in NearSpanOrdered.java now required Java 1.5 in order to compile Lucene. This would re

[jira] Updated: (LUCENE-697) Scorer.skipTo affects sloppyPhrase scoring

2006-10-27 Thread Doron Cohen (JIRA)
[ http://issues.apache.org/jira/browse/LUCENE-697?page=all ] Doron Cohen updated LUCENE-697: --- Attachment: sloppy_phrase_skipTo.patch This was tricky, for me anyhow, but I think I found it. The difference in scoring between using next() to using skipTo() (

[jira] Commented: (LUCENE-569) NearSpans skipTo bug

2006-10-27 Thread Doron Cohen (JIRA)
[ http://issues.apache.org/jira/browse/LUCENE-569?page=comments#action_12445294 ] Doron Cohen commented on LUCENE-569: Chris Hostetter wrote: > Really? ... the build.xml currently sets the javac -source and -target to > 1.4 so if that were t

[jira] Updated: (LUCENE-697) Scorer.skipTo affects sloppyPhrase scoring

2006-10-27 Thread Doron Cohen (JIRA)
[ http://issues.apache.org/jira/browse/LUCENE-697?page=all ] Doron Cohen updated LUCENE-697: --- Lucene Fields: [Patch Available] (was: [New]) > Scorer.skipTo affects sloppyPhrase scoring > -- > > Key:

[jira] Commented: (LUCENE-665) temporary file access denied on Windows

2006-10-29 Thread Doron Cohen (JIRA)
[ http://issues.apache.org/jira/browse/LUCENE-665?page=comments#action_12445507 ] Doron Cohen commented on LUCENE-665: Michael, I am not able to generate this with native locks. (did not try with lockless commits). Which brings me to think t

[jira] Commented: (LUCENE-665) temporary file access denied on Windows

2006-10-30 Thread Doron Cohen (JIRA)
[ http://issues.apache.org/jira/browse/LUCENE-665?page=comments#action_12445724 ] Doron Cohen commented on LUCENE-665: > Odd that just by using native locking, it stopped your issues. Agree. I did not expect that to happen, since indeed I sa

[jira] Commented: (LUCENE-697) Scorer.skipTo affects sloppyPhrase scoring

2006-10-30 Thread Doron Cohen (JIRA)
[ http://issues.apache.org/jira/browse/LUCENE-697?page=comments#action_12445795 ] Doron Cohen commented on LUCENE-697: An updated version of this patch - sloppy_phrase_skipTo.patch2. I modified QueryUtils.java (test util) to test all the seq

[jira] Created: (LUCENE-706) Index File Format - Example for frequency file .frq is wrong

2006-11-02 Thread Doron Cohen (JIRA)
Index File Format - Example for frequency file .frq is wrong Key: LUCENE-706 URL: http://issues.apache.org/jira/browse/LUCENE-706 Project: Lucene - Java Issue Type: Improvement

[jira] Updated: (LUCENE-706) Index File Format - Example for frequency file .frq is wrong

2006-11-02 Thread Doron Cohen (JIRA)
[ http://issues.apache.org/jira/browse/LUCENE-706?page=all ] Doron Cohen updated LUCENE-706: --- Attachment: file-format-frq-example.patch example fixed > Index File Format - Example for frequency file .frq is wrong >

[jira] Updated: (LUCENE-706) Index File Format - Example for frequency file .frq is wrong

2006-11-02 Thread Doron Cohen (JIRA)
[ http://issues.apache.org/jira/browse/LUCENE-706?page=all ] Doron Cohen updated LUCENE-706: --- Lucene Fields: [New, Patch Available] (was: [New]) > Index File Format - Example for frequency file .frq is wrong > -

[jira] Commented: (LUCENE-706) Index File Format - Example for frequency file .frq is wrong

2006-11-03 Thread Doron Cohen (JIRA)
[ http://issues.apache.org/jira/browse/LUCENE-706?page=comments#action_12447042 ] Doron Cohen commented on LUCENE-706: Right - 15 = 2 * 7 + 1--> doc 7 with freq 1 8 = 2 * (11 - 7) --> doc 11 with frequency > 1 3

[jira] Commented: (LUCENE-706) Index File Format - Example for frequency file .frq is wrong

2006-11-03 Thread Doron Cohen (JIRA)
[ http://issues.apache.org/jira/browse/LUCENE-706?page=comments#action_12447049 ] Doron Cohen commented on LUCENE-706: Right, sorry, copied that hex data from an .frq of an index with a different example, where the frequencies were 1 in doc

[jira] Commented: (LUCENE-697) Scorer.skipTo affects sloppyPhrase scoring

2006-11-04 Thread Doron Cohen (JIRA)
[ http://issues.apache.org/jira/browse/LUCENE-697?page=comments#action_12447234 ] Doron Cohen commented on LUCENE-697: You're right Yonik, pp1.offset < pp2.offset is equivalent. However note that pp1.position + pp1.offset == tp1.positi

[jira] Updated: (LUCENE-675) Lucene benchmark: objective performance test for Lucene

2006-11-07 Thread Doron Cohen (JIRA)
[ http://issues.apache.org/jira/browse/LUCENE-675?page=all ] Doron Cohen updated LUCENE-675: --- Attachment: timedata.zip I tried it and it is working nice! - 1st run downloaded the documents from the Web before starting to index. 2nd run started right off

[jira] Commented: (LUCENE-675) Lucene benchmark: objective performance test for Lucene

2006-11-12 Thread Doron Cohen (JIRA)
[ http://issues.apache.org/jira/browse/LUCENE-675?page=comments#action_12449117 ] Doron Cohen commented on LUCENE-675: I looked at extending the benchmark with: - different test "scenarios", i.e. other sequences of operations. - multithreaded

[jira] Updated: (LUCENE-675) Lucene benchmark: objective performance test for Lucene

2006-11-12 Thread Doron Cohen (JIRA)
[ http://issues.apache.org/jira/browse/LUCENE-675?page=all ] Doron Cohen updated LUCENE-675: --- Attachment: tiny.alg tiny.properties I am attaching a sample tiny.* - the .alg and .properties files I currently use - I think they may help to u

[jira] Commented: (LUCENE-675) Lucene benchmark: objective performance test for Lucene

2006-11-13 Thread Doron Cohen (JIRA)
[ http://issues.apache.org/jira/browse/LUCENE-675?page=comments#action_12449419 ] Doron Cohen commented on LUCENE-675: Sounds good. In this case I will add my stuff under a new package: org.apache.lucene.benchmark2. (this package would have

[jira] Commented: (LUCENE-675) Lucene benchmark: objective performance test for Lucene

2006-11-14 Thread Doron Cohen (JIRA)
[ http://issues.apache.org/jira/browse/LUCENE-675?page=comments#action_12449779 ] Doron Cohen commented on LUCENE-675: Good point on names with numbers - I'm renaming the package to taskBenchmark, as I think of it as "task sequence" based, m

[jira] Commented: (LUCENE-675) Lucene benchmark: objective performance test for Lucene

2006-11-15 Thread Doron Cohen (JIRA)
[ http://issues.apache.org/jira/browse/LUCENE-675?page=comments#action_12449947 ] Doron Cohen commented on LUCENE-675: Would be nice to get some feedback on what I already have at this point for the "task based benchmark framework for Lucene

[jira] Updated: (LUCENE-675) Lucene benchmark: objective performance test for Lucene

2006-11-15 Thread Doron Cohen (JIRA)
[ http://issues.apache.org/jira/browse/LUCENE-675?page=all ] Doron Cohen updated LUCENE-675: --- Attachment: taskBenchmark.zip Attached taskBenchmark.zip as described earlier. > Lucene benchmark: objective performance test for Lucene > --

[jira] Updated: (LUCENE-675) Lucene benchmark: objective performance test for Lucene

2006-11-16 Thread Doron Cohen (JIRA)
[ http://issues.apache.org/jira/browse/LUCENE-675?page=all ] Doron Cohen updated LUCENE-675: --- Attachment: benchmark.byTask.patch I am attaching benchmark.byTask.patch - to be applied in the contrib/benchmark directory. Root package of byTask classes was

[jira] Commented: (LUCENE-717) src builds fail because of no "lib" directory

2006-11-27 Thread Doron Cohen (JIRA)
[ http://issues.apache.org/jira/browse/LUCENE-717?page=comments#action_12453672 ] Doron Cohen commented on LUCENE-717: That's because junit,jar is required for compiling and running the tests. (Guess we can't distribute junit.jar with Lucene

[jira] Commented: (LUCENE-717) src builds fail because of no "lib" directory

2006-11-27 Thread Doron Cohen (JIRA)
[ http://issues.apache.org/jira/browse/LUCENE-717?page=comments#action_12453699 ] Doron Cohen commented on LUCENE-717: ...right... Mixed up the two because building Lucene with IDE felt wrong to point the IDE to the ant directories for jun

[jira] Updated: (LUCENE-717) src builds fail because of no "lib" directory

2006-11-27 Thread Doron Cohen (JIRA)
[ http://issues.apache.org/jira/browse/LUCENE-717?page=all ] Doron Cohen updated LUCENE-717: --- Attachment: common-build.xml.patch.txt "compile-test" target verifies that a lib dir exists. > src builds fail because of no "lib" directory > --

[jira] Updated: (LUCENE-717) src builds fail because of no "lib" directory

2006-11-27 Thread Doron Cohen (JIRA)
[ http://issues.apache.org/jira/browse/LUCENE-717?page=all ] Doron Cohen updated LUCENE-717: --- Lucene Fields: [New, Patch Available] (was: [New]) > src builds fail because of no "lib" directory > - > >

[jira] Commented: (LUCENE-717) src builds fail because of no "lib" directory

2006-11-27 Thread Doron Cohen (JIRA)
[ http://issues.apache.org/jira/browse/LUCENE-717?page=comments#action_12453738 ] Doron Cohen commented on LUCENE-717: I'm ok with this... > src builds fail because of no "lib" directory > - > >

[jira] Commented: (LUCENE-708) Setup nightly build website links and docs

2006-11-29 Thread Doron Cohen (JIRA)
[ http://issues.apache.org/jira/browse/LUCENE-708?page=comments#action_12454375 ] Doron Cohen commented on LUCENE-708: Could "official" be the most recent release (currently 2.0)? So there would be: Official (2.0) Nightly 1.9.1 1.9 1.4

[jira] Created: (LUCENE-736) Sloppy Phrase Scoring Misbehavior

2006-12-01 Thread Doron Cohen (JIRA)
Sloppy Phrase Scoring Misbehavior - Key: LUCENE-736 URL: http://issues.apache.org/jira/browse/LUCENE-736 Project: Lucene - Java Issue Type: Bug Components: Search Reporter: Doron Cohen

[jira] Commented: (LUCENE-697) Scorer.skipTo affects sloppyPhrase scoring

2006-12-01 Thread Doron Cohen (JIRA)
[ http://issues.apache.org/jira/browse/LUCENE-697?page=comments#action_12454844 ] Doron Cohen commented on LUCENE-697: I went on documenting sloppy phrase scorer and phrase scorer, so that the fix above can make it in more comfortably. Howev

[jira] Updated: (LUCENE-736) Sloppy Phrase Scoring Misbehavior

2006-12-01 Thread Doron Cohen (JIRA)
[ http://issues.apache.org/jira/browse/LUCENE-736?page=all ] Doron Cohen updated LUCENE-736: --- Attachment: sloppy_phrase_tests.patch.txt sloppy_phrase_tests.patch.txt contains: - two test cases added in TestPhraseQuery. These new tests currently fail.

[jira] Updated: (LUCENE-736) Sloppy Phrase Scoring Misbehavior

2006-12-01 Thread Doron Cohen (JIRA)
[ http://issues.apache.org/jira/browse/LUCENE-736?page=all ] Doron Cohen updated LUCENE-736: --- Attachment: sloppy_phrase_java.patch.txt perf-search-new.log perf-search-orig.log Attached sloppy_phrase_java.patch.txt is fixing

[jira] Updated: (LUCENE-736) Sloppy Phrase Scoring Misbehavior

2006-12-02 Thread Doron Cohen (JIRA)
[ http://issues.apache.org/jira/browse/LUCENE-736?page=all ] Doron Cohen updated LUCENE-736: --- Attachment: sloppy_phrase.patch2.txt res-search-orig2.log res-search-new2.log The change to fix case 2 was not the main performanc

[jira] Updated: (LUCENE-736) Sloppy Phrase Scoring Misbehavior

2006-12-02 Thread Doron Cohen (JIRA)
[ http://issues.apache.org/jira/browse/LUCENE-736?page=all ] Doron Cohen updated LUCENE-736: --- Lucene Fields: [New, Patch Available] (was: [New]) > Sloppy Phrase Scoring Misbehavior > - > > Key: LUCENE-736 >

[jira] Commented: (LUCENE-736) Sloppy Phrase Scoring Misbehavior

2006-12-04 Thread Doron Cohen (JIRA)
[ http://issues.apache.org/jira/browse/LUCENE-736?page=comments#action_12455422 ] Doron Cohen commented on LUCENE-736: There is a bug in my recent patch (sloppy_phrase.patch2.txt): - for the case of phrase with repetitions, some additional co

[jira] Updated: (LUCENE-736) Sloppy Phrase Scoring Misbehavior

2006-12-04 Thread Doron Cohen (JIRA)
[ http://issues.apache.org/jira/browse/LUCENE-736?page=all ] Doron Cohen updated LUCENE-736: --- Attachment: sloppy_phrase.patch3.txt Test case - testNonExistingWrappedPhrase - was extended. A bug in the patch (described above) was fixed. All tests pass.

[jira] Created: (LUCENE-738) read/write .del as d-gaps when the deleted bit vector is sufficiently sparse

2006-12-04 Thread Doron Cohen (JIRA)
read/write .del as d-gaps when the deleted bit vector is sufficiently sparse - Key: LUCENE-738 URL: http://issues.apache.org/jira/browse/LUCENE-738 Project: Lucene - Java

[jira] Commented: (LUCENE-738) read/write .del as d-gaps when the deleted bit vector is sufficiently sparse

2006-12-06 Thread Doron Cohen (JIRA)
[ http://issues.apache.org/jira/browse/LUCENE-738?page=comments#action_12456216 ] Doron Cohen commented on LUCENE-738: I tried two implementations: (1) writing d-gaps for ids of deleted docs, and (2) writing d-gaps for indexes of non zero by

[jira] Updated: (LUCENE-738) read/write .del as d-gaps when the deleted bit vector is sufficiently sparse

2006-12-06 Thread Doron Cohen (JIRA)
[ http://issues.apache.org/jira/browse/LUCENE-738?page=all ] Doron Cohen updated LUCENE-738: --- Attachment: del.dgap.patch.txt Patch added: "del.dgap.patch.txt" for the above optn "(1) writing d-gaps for ids of deleted docs". Patch changes index format, bu

[jira] Updated: (LUCENE-738) read/write .del as d-gaps when the deleted bit vector is sufficiently sparse

2006-12-06 Thread Doron Cohen (JIRA)
[ http://issues.apache.org/jira/browse/LUCENE-738?page=all ] Doron Cohen updated LUCENE-738: --- Lucene Fields: [Patch Available] (was: [New]) > read/write .del as d-gaps when the deleted bit vector is sufficiently sparse > --

[jira] Commented: (LUCENE-738) read/write .del as d-gaps when the deleted bit vector is sufficiently sparse

2006-12-06 Thread Doron Cohen (JIRA)
[ http://issues.apache.org/jira/browse/LUCENE-738?page=comments#action_12456224 ] Doron Cohen commented on LUCENE-738: > are d-gaps written as a 4 byte integer or as a variable vInt, > and what drove the decision behind that? Vints are use

[jira] Updated: (LUCENE-738) read/write .del as d-gaps when the deleted bit vector is sufficiently sparse

2006-12-07 Thread Doron Cohen (JIRA)
[ http://issues.apache.org/jira/browse/LUCENE-738?page=all ] Doron Cohen updated LUCENE-738: --- Attachment: FileFormatDoc.patch.txt FileFormat document updated to reflect this format change. > read/write .del as d-gaps when the deleted bit vector is suffici

[jira] Commented: (LUCENE-740) Bugs in contrib/snowball/.../SnowballProgram.java -> Kraaij-Pohlmann gives Index-OOB Exception

2006-12-11 Thread Doron Cohen (JIRA)
[ http://issues.apache.org/jira/browse/LUCENE-740?page=comments#action_12457462 ] Doron Cohen commented on LUCENE-740: In addition to SnowballProgram bug fix there are few updates in snowball.tartarus.org comparing to snowball stemmers in Lu

[jira] Updated: (LUCENE-740) Bugs in contrib/snowball/.../SnowballProgram.java -> Kraaij-Pohlmann gives Index-OOB Exception

2006-12-11 Thread Doron Cohen (JIRA)
[ http://issues.apache.org/jira/browse/LUCENE-740?page=all ] Doron Cohen updated LUCENE-740: --- Attachment: snowball.patch.txt Updated + new stemmers and SnowballProgram fix from http://snowball.tartarus.org > Bugs in contrib/snowball/.../SnowballProgram.ja

[jira] Commented: (LUCENE-740) Bugs in contrib/snowball/.../SnowballProgram.java -> Kraaij-Pohlmann gives Index-OOB Exception

2006-12-11 Thread Doron Cohen (JIRA)
[ http://issues.apache.org/jira/browse/LUCENE-740?page=comments#action_12457605 ] Doron Cohen commented on LUCENE-740: Attached "snowball.patch.txt" has "latest and greatest" plus new test case in TestSnowball that demostrates this Kp stemme

[jira] Commented: (LUCENE-740) Bugs in contrib/snowball/.../SnowballProgram.java -> Kraaij-Pohlmann gives Index-OOB Exception

2006-12-12 Thread Doron Cohen (JIRA)
[ http://issues.apache.org/jira/browse/LUCENE-740?page=comments#action_12457619 ] Doron Cohen commented on LUCENE-740: Two comments: 1. Testing: There's only limited testing in Lucene's contrib for these stemmers - we could probably add a s

[jira] Created: (LUCENE-756) Maintain norms in a single file .nrm

2006-12-20 Thread Doron Cohen (JIRA)
Maintain norms in a single file .nrm Key: LUCENE-756 URL: http://issues.apache.org/jira/browse/LUCENE-756 Project: Lucene - Java Issue Type: Improvement Reporter: Doron Cohen Prior

[jira] Assigned: (LUCENE-756) Maintain norms in a single file .nrm

2006-12-20 Thread Doron Cohen (JIRA)
[ http://issues.apache.org/jira/browse/LUCENE-756?page=all ] Doron Cohen reassigned LUCENE-756: -- Assignee: Doron Cohen > Maintain norms in a single file .nrm > > > Key: LUCENE-756 > UR

[jira] Updated: (LUCENE-756) Maintain norms in a single file .nrm

2006-12-20 Thread Doron Cohen (JIRA)
[ http://issues.apache.org/jira/browse/LUCENE-756?page=all ] Doron Cohen updated LUCENE-756: --- Attachment: nrm.patch.txt Attached patch - nrm.patch.txt - modifies field norms maintenance to a single .nrm file. Modification is backwards compatible - existi

[jira] Updated: (LUCENE-756) Maintain norms in a single file .nrm

2006-12-20 Thread Doron Cohen (JIRA)
[ http://issues.apache.org/jira/browse/LUCENE-756?page=all ] Doron Cohen updated LUCENE-756: --- Lucene Fields: [Patch Available] (was: [New]) > Maintain norms in a single file .nrm > > > Key: LUCENE-756 >

[jira] Updated: (LUCENE-756) Maintain norms in a single file .nrm

2006-12-20 Thread Doron Cohen (JIRA)
[ http://issues.apache.org/jira/browse/LUCENE-756?page=all ] Doron Cohen updated LUCENE-756: --- Component/s: Index > Maintain norms in a single file .nrm > > > Key: LUCENE-756 > URL: http:/

[jira] Updated: (LUCENE-756) Maintain norms in a single file .nrm

2006-12-20 Thread Doron Cohen (JIRA)
[ http://issues.apache.org/jira/browse/LUCENE-756?page=all ] Doron Cohen updated LUCENE-756: --- Attachment: (was: nrm.patch.txt) > Maintain norms in a single file .nrm > > > Key: LUCENE-756 >

[jira] Updated: (LUCENE-756) Maintain norms in a single file .nrm

2006-12-20 Thread Doron Cohen (JIRA)
[ http://issues.apache.org/jira/browse/LUCENE-756?page=all ] Doron Cohen updated LUCENE-756: --- Attachment: nrm.patch.txt Replacing the patch file (prev file was garbage - "svn stat" instead of "svn diff"). Few words on how this patch works: - .nrm file w

[jira] Commented: (LUCENE-756) Maintain norms in a single file .nrm

2006-12-21 Thread Doron Cohen (JIRA)
[ http://issues.apache.org/jira/browse/LUCENE-756?page=comments#action_12460292 ] Doron Cohen commented on LUCENE-756: > Does this mean a separate file outside the final .cfs files? Oh no - there's a single .nrm file in the .cfs file (inste

[jira] Commented: (LUCENE-756) Maintain norms in a single file .nrm

2006-12-21 Thread Doron Cohen (JIRA)
[ http://issues.apache.org/jira/browse/LUCENE-756?page=comments#action_12460316 ] Doron Cohen commented on LUCENE-756: Thanks for the comments, Doug. You're right of course, I will add both the header and the constant. (that would be either

[jira] Updated: (LUCENE-756) Maintain norms in a single file .nrm

2006-12-22 Thread Doron Cohen (JIRA)
[ http://issues.apache.org/jira/browse/LUCENE-756?page=all ] Doron Cohen updated LUCENE-756: --- Attachment: nrm.patch.2.txt nrm.patch.2.txt: Updated as Doug suggested: - ".nrm" extension now maintained in a constant . - .nrm file now has a 4 bytes header.

[jira] Commented: (LUCENE-756) Maintain norms in a single file .nrm

2007-01-03 Thread Doron Cohen (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-756?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12462069 ] Doron Cohen commented on LUCENE-756: I am updating the patch (nrm.patch.3.txt): - using a single constant for t

[jira] Updated: (LUCENE-756) Maintain norms in a single file .nrm

2007-01-03 Thread Doron Cohen (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-756?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Doron Cohen updated LUCENE-756: --- Attachment: nrm.patch.3.txt > Maintain norms in a single file .nrm >

[jira] Commented: (LUCENE-675) Lucene benchmark: objective performance test for Lucene

2007-01-04 Thread Doron Cohen (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-675?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12462287 ] Doron Cohen commented on LUCENE-675: Grant, thanks for trying this out - I will update the patch shortly. I am u

  1   2   3   4   5   6   7   >