r the lucene trunk
/memoryindex <--- stuff for wolfgang
All tests pass, except remote, multi and parallell searchers.
Jira admins: you are more than welcome to remove all old attachments, except
images.
> InstanciatedIndex - faster but memo
tween measuring indexing or querying. Example output
for measuring query throughput on simple term queries: ~50 queries/sec on a
MacBook Pro, jdk 1.5.0_06, server VM. As always, your mileage may vary.
> InstanciatedIndex - faster but memory consumi
lysis?
> InstanciatedIndex - faster but memory consuming index
> -
>
> Key: LUCENE-550
> URL: http://issues.apache.org/jira/browse/LUCENE-550
> Project: Lucene - Java
> Issue Type: New Fea
RAMDirectory) does InstantiatedIndex pass all tests? That
would be great!
> InstanciatedIndex - faster but memory consuming index
> -
>
> Key: LUCENE-550
> URL: http://issues.apache.org/jira/br
s/sec= 1093.2944
MB/sec = 34.17
Done benchmarking (without checking correctness).
MemoryIndex is a bit faster than InstantiatedIndex. But I'm aware of a couple
of small optimizations I can do.
> InstanciatedIndex - faster but memory co
some cases.
I will however run your suggested tests tomorrow and report back.
And post the latest patches, including my adaptation of your unit test, in case
you want to explore it by your self.
> InstanciatedIndex - faster but memory c
21 nov 2006 kl. 21.52 skrev wolfgang hoschek (JIRA):
For some more exhaustive tests, run all the queries
I'm at home now. Will continue tomorrow.
-
To unsubscribe, e-mail: [EMAIL PROTECTED]
For additional commands, e-mail: [
) and not scoreII - scoreRAM ; )
> InstanciatedIndex - faster but memory consuming index
> -
>
> Key: LUCENE-550
> URL: http://issues.apache.org/jira/browse/LUCENE-550
> Project: Lucene - Java
>
ON_WORD_PATTERN, false, null),
//new PatternAnalyzer(PatternAnalyzer.NON_WORD_PATTERN, true,
stopWords),
//new SnowballAnalyzer("English", StopAnalyzer.ENGLISH_STOP_WORDS),
};
> InstanciatedIndex - faster but memory consuming index
> -
=0.023488527
diff=-0.043373547, query=Apach~ AND Copy*, scoreII=0.043373547,
scoreRAM=0.043373547
secs = 3.766
queries/sec= 2.655337
MB/sec = 0.083386995
No bug found. done.
Process finished with exit code 0
> InstanciatedIndex - faster but memory
ery mix found in testqueries.txt is more intended for correctness testing
than benchmarking. Therein, certain query types dominate over others, and thus,
conclusions about the performance of individual aspects cannot easily be drawn.
Wolfgang.
> InstanciatedIndex - faster but mem
?
> InstanciatedIndex - faster but memory consuming index
> -
>
> Key: LUCENE-550
> URL: http://issues.apache.org/jira/browse/LUCENE-550
> Project: Lucene - Java
> Is
amless promotion:
I'm actually in the progress of porting all my old diagrams to
<http://www.appliedmodels.com/>, this fantastic MDA-tool a friend of mine just
released to the public. So quite soon there will be new diagrams. Pehaps even
PDF.
Until then you're stuck to zooming :)
> I
On Wed, 2006-07-26 at 13:56 -0700, Otis Gospodnetic wrote:
>
> I haven't exactly looked at the source code in your branch, but I
> always wondered how changes in your personal branch off of Lucene 2
> will ever get into the main trunk, since your efforts are, I think,
> omstly out of sync with pat
[
http://issues.apache.org/jira/browse/LUCENE-550?page=comments#action_12423719 ]
Dejan Nenov commented on LUCENE-550:
Can we please get the class diagrams in PDF format - the PNGs are so tny - they
are undreadable :(
> InstanciatedIn
y mom says hi to your mom.
Otis
- Original Message
From: Karl Wettin (JIRA) <[EMAIL PROTECTED]>
To: [email protected]
Sent: Thursday, July 20, 2006 4:05:21 AM
Subject: [jira] Commented: (LUCENE-550) InstanciatedIndex - faster but memory
consuming index
[
http://issues
me, but it would be nice if they passed.
> InstanciatedIndex - faster but memory consuming index
> -
>
> Key: LUCENE-550
> URL: http://issues.apache.org/jira/browse/LUCENE-550
> Proj
-finalized
Document and Term) and one new class (InterfaceIndexWriter implemented by
IndexWriter in patch) instead of attaching the whole trunk.
Still fails a few score- and RMI-tests.
> InstanciatedIndex - faster but memory consuming in
JUnitStarter.java:32)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:64)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at com.intellij
e use this code, don't. :-)
Hopefully most of the problems share the same problem. I'll be at the code this
weekend, and perhaps a few days next week if needed.
> InstanciatedIndex - faster but memory consuming index
> -
>
>
count have been reached?)
> InstanciatedIndex - faster but memory consuming index
> -
>
> Key: LUCENE-550
> URL: http://issues.apache.org/jira/browse/LUCENE-550
> Project: Lucene - Jav
mount of
terms. have seen 20x-200x) than RAMDirectory when comparing search and to
retrieve documents time combined.
> InstanciatedIndex - faster but memory consuming index
> -
>
> Key: LUCENE-550
>
[
http://issues.apache.org/jira/browse/LUCENE-550?page=comments#action_12416583 ]
Karl Wettin commented on LUCENE-550:
There is a bug with phrase queries. Possible term positions. Low priority for
me.
> InstanciatedIndex - faster but memory consum
[
http://issues.apache.org/jira/browse/LUCENE-550?page=comments#action_12416271 ]
Karl Wettin commented on LUCENE-550:
> I'll come with a new number soon enough.
Right, it was 25% faster. So forget everthing I said about anything.
> Instan
re. So forget about the 1500. I'll come with a new number soon enough.
> InstanciatedIndex - faster but memory consuming index
> -
>
> Key: LUCENE-550
> URL: http://issues.apache.org/jira/browse/LUCENE-
On Wed, 2006-06-14 at 07:36 +, Karl Wettin (JIRA) wrote:
>
>
> If eveything works as it should (I think so) then I'm happy to report
> that a FuzzyQuery seems to be about 1500 (one thousand five hundred)
> times faster on this memory implementation than on a RAMDirectory. The
> speed is gaine
hat a
FuzzyQuery seems to be about 1500 (one thousand five hundred) times faster on
this memory implementation than on a RAMDirectory. The speed is gained by not
creating a new instance of each Term in a TermEnum.
> InstanciatedIndex - faster but memory consumi
[ http://issues.apache.org/jira/browse/LUCENE-550?page=all ]
Otis Gospodnetic updated LUCENE-550:
Attachment: (was: src.tar.gz)
> InstanciatedIndex - faster but memory consuming in
[ http://issues.apache.org/jira/browse/LUCENE-550?page=all ]
Otis Gospodnetic updated LUCENE-550:
Attachment: (was: InstanciatedIndex.java)
> InstanciatedIndex - faster but memory consuming in
[ http://issues.apache.org/jira/browse/LUCENE-550?page=all ]
Otis Gospodnetic updated LUCENE-550:
Attachment: (was: src_20060509.tar.gz)
> InstanciatedIndex - faster but memory consuming in
[ http://issues.apache.org/jira/browse/LUCENE-550?page=all ]
Otis Gospodnetic updated LUCENE-550:
Attachment: (was: src-1.9karl1_20060611.tar.gz)
> InstanciatedIndex - faster but memory consuming in
[ http://issues.apache.org/jira/browse/LUCENE-550?page=all ]
Otis Gospodnetic updated LUCENE-550:
Attachment: (was: Term.java)
> InstanciatedIndex - faster but memory consuming in
[ http://issues.apache.org/jira/browse/LUCENE-550?page=all ]
Otis Gospodnetic updated LUCENE-550:
Attachment: (was: Document.java)
> InstanciatedIndex - faster but memory consuming in
[ http://issues.apache.org/jira/browse/LUCENE-550?page=all ]
Karl Wettin updated LUCENE-550:
---
Attachment: instanciated_20060527.tar
This update makes InstanciatedIndex compatible with Lucene, given that issue
580 and 581 is adopted.
It depends on
[ http://issues.apache.org/jira/browse/LUCENE-550?page=all ]
Karl Wettin updated LUCENE-550:
---
Attachment: lucene.1.9-karl1.jpg
This is the diagram of InstanciatedIndex as of 1.9-karl1
> InstanciatedIndex - faster but memory consuming in
On Thu, 2006-05-11 at 18:46 +, Karl Wettin (JIRA) wrote:
> for 2.0, tolk me what
tell me what..
-
To unsubscribe, e-mail: [EMAIL PROTECTED]
For additional commands, e-mail: [EMAIL PROTECTED]
OK with and gave me
at least two weeks notice I /might/ find time to back-factor the code.
> InstanciatedIndex - faster but memory consuming index
> -
>
> Key: LUCENE-550
> URL: http://issues.apache.org/jira/brows
e the back-compatiblity.
> InstanciatedIndex - faster but memory consuming index
> -
>
> Key: LUCENE-550
> URL: http://issues.apache.org/jira/browse/LUCENE-550
> Project: Lucene - Java
> Ty
.
Now about 40x faster than RAMDirectory.
Stats for test: 500 documents. 1-5K text content.
10 000 * 5 spans
10 000 * 13 term and boolean term queries.
collected top 100 documents for each search results.
InstanciatedIndex is 40x faster than the RAMDirectory.
InstanciatedIndex running on Lucene 1.9
[
http://issues.apache.org/jira/browse/LUCENE-550?page=comments#action_12378776 ]
Karl Wettin commented on LUCENE-550:
Oups
InstanciatedIndex:
Corpus creation took 14011 ms.
Term queries took 33608 ms.
RAMDirectory:
Corpus creation took 9144 ms.
Term
for real yet.
Hope to have that working and an updated class diagram for you soon.
> InstanciatedIndex - faster but memory consuming index
> -
>
> Key: LUCENE-550
> URL: http://issues.apache.org/jira/browse/LUCENE-
I'm about to release a new version. Is there a specific corpus you want
me to use for the test case?
-
To unsubscribe, e-mail: [EMAIL PROTECTED]
For additional commands, e-mail: [EMAIL PROTECTED]
ds to be refactored.
> InstanciatedIndex - faster but memory consuming index
> -
>
> Key: LUCENE-550
> URL: http://issues.apache.org/jira/browse/LUCENE-550
> Project: Lucene - Java
> Type: New Feat
[
http://issues.apache.org/jira/browse/LUCENE-550?page=comments#action_12375453 ]
Karl Wettin commented on LUCENE-550:
Due to read and write locks, this is how one must use the extention:
InstanciatedIndex ii = new InstanciatedIndex();
IndexWriter iw
[ http://issues.apache.org/jira/browse/LUCENE-550?page=all ]
Karl Wettin updated LUCENE-550:
---
Attachment: class_diagram.png
Class diagram over InstanciatedIndex
> InstanciatedIndex - faster but memory consuming in
ormal. :-)
See the class diagram to understand what I did.
> InstanciatedIndex - faster but memory consuming index
> -
>
> Key: LUCENE-550
> URL: http://issues.apache.org/jira/browse/LUCENE-550
> Project: Lucen
IndexReader as the information it returns in
many situations already available in the information passed IndexReader, but
I'm afraid it might be a Pyrrhus victory as the Jit usually automatically
"caches" things like that. There are more obvious places to save ticks, e.g.
replacin
yway
(see comments in SmallFloat class). So I wouldn't expect float[] norms to be
mesurably faster than byte[] norms in the context of a complete search.
> InstanciatedIndex - faster but memory consuming index
> -
>
>
[ http://issues.apache.org/jira/browse/LUCENE-550?page=all ]
Karl Wettin updated LUCENE-550:
---
Attachment: Document.java
> InstanciatedIndex - faster but memory consuming index
> -
>
>
[ http://issues.apache.org/jira/browse/LUCENE-550?page=all ]
Karl Wettin updated LUCENE-550:
---
Attachment: Term.java
> InstanciatedIndex - faster but memory consuming index
> -
>
>
[ http://issues.apache.org/jira/browse/LUCENE-550?page=all ]
Karl Wettin updated LUCENE-550:
---
Attachment: InstanciatedIndex.java
> InstanciatedIndex - faster but memory consuming in
InstanciatedIndex - faster but memory consuming index
-
Key: LUCENE-550
URL: http://issues.apache.org/jira/browse/LUCENE-550
Project: Lucene - Java
Type: New Feature
Components: Store
Versions: 1.9
52 matches
Mail list logo
