[Neo4j] Comparing Lucene index lookup performance to lookup by node id

2011-11-03 Thread Tero Paananen
This is probably not news to anyone, but I might as well post about it in case new users are wondering about performance between index based lookups and lookups by node ids. I have a test database of 750,000 nodes of type A. The db also contains 90,000 nodes of types B and C, and roughly 4M

Re: [Neo4j] Comparing Lucene index lookup performance to lookup by node id

2011-11-03 Thread Mattias Persson
Indexes, while fast they are still an indirection and way slower than a direct access of something. So this is quite expected. 2011/11/3 Tero Paananen tpp.paana...@gmail.com This is probably not news to anyone, but I might as well post about it in case new users are wondering about performance

Re: [Neo4j] Comparing Lucene index lookup performance to lookup by node id

2011-11-03 Thread Tero Paananen
Indexes, while fast they are still an indirection and way slower than a direct access of something. So this is quite expected. Agreed. I wanted to run the performance tests to find out how much slower the index lookups are. Would they have been 2x - 4x slower, it would've probably still been

Re: [Neo4j] Comparing Lucene index lookup performance to lookup by node id

2011-11-03 Thread Michael Hunger
Hi Tero, thanks for the valueable feedback. Please note that SDN is not yet optimized in all places. So I'd love your input by profiling your use-case. It is probably something in between. Can you use visualvm or yourkit or another profiler to figure out the hotspot methods where the most

Re: [Neo4j] Comparing Lucene index lookup performance to lookup by node id

2011-11-03 Thread Tero Paananen
So I'd love your input by profiling your use-case. It is probably something in between. Can you use visualvm or yourkit or another profiler to figure out the hotspot methods where the most time is spent for the index-lookup. I would also love to pair with you on this. (Or get your