Mark,
I had a look at this and you try to inject 130M relationships with a
relationship store configured to 700M. That will not be an efficient
insert. If your relationships and data are not sorted the batch
inserter would have to unload and load blocks of data as soon as you
get over around 22M r
Hi,
I am assuming no manual modifying of log files or store files at
runtime or between shutdowns/crashes and startups has been performed.
What filesystem are you running this on (and with what configuration)?
Massimo since you say it happen more and more if the db grows can you
write a test cas
Could you start by verifying it is not GC related. Turn on verbose GC
and see if larger transactions trigger GC pause times.
Another possible cause could be that the relationship store file has
grown so configuration needs to be tweaked. The OS may be flushing
pages to disk when it should not. The
inning and the end of the "index".
>
> Best,
>
> Rick
>
>
> -Original Message-
> From: user-boun...@lists.neo4j.org [mailto:user-boun...@lists.neo4j.org] On
> Behalf Of Johan Svensson
> Sent: Tuesday, March 22, 2011 5:56 AM
> To: Neo4j user discussio
Bob,
How much RAM does the machine have?
On Thu, Apr 21, 2011 at 9:53 PM, Bob Hutchison wrote:
>
>>> ./run ../store logfile 33 1000 5000 100
> tx_count[100] records[298245] fdatasyncs[100] read[9.386144 MB]
> wrote[18.772287 MB]
> Time was: 199.116
> 0.5022198 tx/s, 1497.8455 records/s, 0.50221
.I need it very urgently.
> Please let me know the possible solutions for this question.
> Thank you.
>
--
Johan Svensson [jo...@neotechnology.com]
Chief Technology Officer, Neo Technology
www.neotechnology.com
___
Neo4j mailing list
User@lists.neo4j.or
Hi,
This will depend on types of queries, access patterns and what the
data look like. Could you provide some more information on what the
data look like, specifically relationships traversed and properties
loaded for a query?
Regarding adding another machine to an already active cluster it is
ea
Hi,
What version of Neo4j are you running and are there any other error
messages written to console or to messages.log when you start up?
Do you have neo4j-lucene-index component on the classpath? The global
transaction log contains a transaction that included the Lucene data
source (branch id 0x
Hi Jose,
Does http://docs.neo4j.org/chunked/1.3/transactions-delete.html answer
your question?
Regards,
Johan
On Tue, May 24, 2011 at 4:34 AM, Jose Angel Inda Herrera
wrote:
> hello list,
> I wonder when a node will be removed in a transaction, since I have a
> transaction in which I delete a n
Hi Jennifier,
Could you apply this patch to the kernel and then see if the problem
still exists? If you want I can send you a jar but then I need to know
what version of Neo4j you are using.
Regards,
Johan
On Mon, May 23, 2011 at 6:50 PM, Jennifer Hickey wrote:
> Hi Tobias,
>
> Looks like the
Hi,
You can assume all Neo4j APIs are thread safe. If something is not
thread safe it will be explicitly stated in the javadocs.
If you keep all state that has to be shared between threads in the
graph and all other state thread local you don't have to perform any
external (or extra) synchronizat
Hi,
Neo4j requires a filesystem and that filesystem may be mounted in RAM
or not. You can only control the location of the graph store through
the API but it has to be on a supported filesystem.
On Linux a in memory graph db can easily be created using /dev/shm:
GraphDatabaseService inMemoryG
, McKinley wrote:
> Johan,
>
> In that Servlet example is the synchronized get on the graphDb reference
> still necessary on the ServletContextListener?
>
> Thanks,
>
> McKinley
>
> On Tue, Jun 7, 2011 at 1:03 AM, Johan Svensson wrote:
>
>> Hi,
>>
>>
You could modify the structure of how the collection is stored so
there are several chains that can be updated in parallel for each
collection. Kind of how ConcurrentHashMap works with several locks.
-Johan
On Fri, Jun 10, 2011 at 12:16 AM, Rick Bullotta
wrote:
> We seem to be encountering a lot
Hi,
Looks like there was an OOME during commit but commit partially
succeeded (removing the xid branch id association for the xa resource)
causing the subsequent rollback call to fail. To guarantee consistency
the kernel will block all mutating operations after this and a restart
+ recovery has to
er-boun...@lists.neo4j.org] On Behalf
> Of Johan Svensson [jo...@neotechnology.com]
> Sent: Thursday, May 26, 2011 3:09 AM
> To: Neo4j user discussions
> Subject: Re: [Neo4j] ClosedChannelExceptions in highly concurrent environment
>
> Hi Jennifier,
>
> Could you apply this p
Hi,
That is possible (and even recommended). The Java API is thread safe
(with the exception of batch inserter) both for reads and writes.
Each thread may use its own transaction but it is not required to have
a transaction when performing read operations (only for writes).
Reading is lock free a
Paul,
This could be related to the wrapper bug found if you are running the
server. If the server was under heavy load and entered GC trashing
(JVM stopping all threads just running GC) the wrapper thought the
server was unresponsive and restarted it. This problem will be fixed
in the 1.4.M05 rele
Hi,
This may be of interest http://arxiv.org/abs/1004.1001 (The Graph
Traversal Pattern) and
http://markorodriguez.com/2011/02/18/mysql-vs-neo4j-on-a-large-scale-graph-traversal/
Regards,
Johan
2011/6/27 Ian Bussières :
> Hello,
>
> I am using neo4j in a school project. I was wondering if anyone
Hi Dario,
Could you post the error message and stacktrace?
Did the error happen after initial import but still running in batch
inserter mode or normal server/embedded transactional mode?
Regards,
Johan
On Wed, Jun 29, 2011 at 4:30 PM, Dario Rexin wrote:
> Hi all,
>
> Recently i tried import a
On Wed, Dec 30, 2009 at 2:44 PM, Tobias Ivarsson
wrote:
> ... Normal operation does not allow you to create such
> relationships, but the batch insertion mode omits a number of these checks.
>
Correct. It may however be possible to throw an exception when
creating relationship to same node (when
Hi,
On Wed, Dec 30, 2009 at 4:08 PM, Lorenzo Livi wrote:
> Hi all,
> I have two questions about performance.
>
> 1) I need to calculate the degree of a node (outlinks+inlinks). I can
> see that neo4j use lucene to index the node, so each node is a lucene
> document, and we can search the nodes by
Hi,
On Wed, Dec 30, 2009 at 5:07 PM, Raul Raja Martinez wrote:
> Hi everybody,
>
> We're evaluating neo4j and we're very pleased with it so far.
>
> I have a few questions/concerns as far as it scalability beyond a single
> machine.
>
> 1. Can a Neo4J store be accessed from different machines? I'
Hi,
Each unique property name will be assigned an integer value. When
adding 100k properties with the same key the overhead for the key part
of that property will be 400k bytes regardless of length of the
property key.
We will add some information about this on the wiki.
Regards,
Johan
On Sat,
On Wed, Dec 30, 2009 at 4:41 PM, Laurent Laborde wrote:
> When doing purely readonly operation, transaction are not explicitely
> required (and there is nothing to rollback).
> The sql transaction for a select is "automagic", when a potentially
> long select is done, the query work on a "frozen" s
Hi,
The implementation was not thread safe and the last commit to the
underlying implementation was years ago. There was no time to fix it
before the 1.0 release so we decided to remove it. After 1.0 has been
released we may add it again (if the threading issue can be resolved).
Regards
-Johan
Hi,
After some discussions following the input here we decided to go with
no explicit ".api" package but an explicit ".impl" package (for
implementation that is not supposed to be public). The 1.0 release
will then look like this:
o "neo" component renamed to "kernel"
- old core API (org.neo4j
Hi,
On Tue, Jan 12, 2010 at 6:41 AM, Ryan Levering wrote:
> ...
> very cumbersome. In addition, my profiling shows that a lot of
> program time is being spent on transaction management in very simple
> reading code.
There is a small overhead of managing read only transactions. What
numbers do y
Hello,
Neo4j 1.0-rc (release candidate) has just been uploaded.
This release only contains renaming stuff compared to the previous b11
release. There was a mail about this on the list a few days ago but
for those of you who missed it here is an overview:
o "neo" component renamed to "neo4j-kerne
Hi Rick,
On Sun, Jan 17, 2010 at 2:01 AM, Rick Bullotta
wrote:
> Here's a broader question:
>
> Does Neo maintain an in-memory list of relationships for a given node? If
> so, could the # of relationships be exposed somehow as a property of the
> node?
There is an in-memory list of relationship
sk. A warm instance would typically not go down on disk but a cold
(just started, nothing cached) would have to read from disk.
> -Original Message-
> From: user-boun...@lists.neo4j.org [mailto:user-boun...@lists.neo4j.org] On
> Behalf Of Johan Svensson
> Sent: Sunday, January
Hi,
Thread#2 would not be able to commit at 12:03 since it would be
waiting to acquire the write lock on Node#1. After Thread#1 has
committed (12:04) Thread#2 would be able to change the property to
"second" and then commit meaning the value (at 12.05) of the property
would be "second".
You can m
Hi,
I would recommend a domain level REST API. We are working on examples
and documentation for this and hope to have something ready soon.
-Johan
On Fri, Jan 8, 2010 at 10:42 PM, bryan webb wrote:
> Hi I am looking for an example /how to share neo4j between many users.
> What are the recommend
Hi,
The new artifact id and versions for rdf components are:
neo4j-rdf 0.6-SNAPSHOT (svn components/rdf)
neo4j-rdf-sail 0.5-SNAPSHOT (svn components/rdf-sail)
They in turn depend on:
neo4j-kernel 1.0-SNAPSHOT
neo4j-index 1.0-SNAPSHOT
-Johan
On Mon, Jan 18, 2010 at 3:13 PM, Peter Neubauer
wro
No, should work fine.
-Johan
On Thu, Jan 21, 2010 at 3:09 PM, wrote:
> Are there any restrictions on having a Java app host more than one
> GraphDatabaseService? Any issues with transactioning?
>
>
>
> Thanks,
>
>
>
> Rick
___
Neo mailing lis
Hi,
This sounds like a scala wrapper issue.
Short lived write transactions together with long lived reads should
be no problem. By default no locks are taken during reads instead each
read operation behaves as if it took a snapshot of the graph
(committed state) at point of invocation. So to answ
Hi,
On Wed, Jan 27, 2010 at 11:15 PM, Rick Bullotta
wrote:
> Is there any recommendation on when to use additional node/relationship
> connections versus additional node properties?
It depends of use case but go with relationships if it "enriches" the
graph with information that makes sense.
In
Hi,
As Peter pointed out it would be really helpful with some more
information regarding this problem such as:
o full stacktrace
o version of Neo4j kernel running
(neo-1.0-b11/neo4j-kernel-1.0-rc/neo4j-kernel-1.0-SNAPSHOT)
o file system in use (ext3/ext4/ntfs?)
o can the problem be reproduced?
I
Hi,
The active_tx_log should not have anything to do with the "Unable to
lock store". Only one process/JVM can have write access to the same
store at a time. If you try to start multiple GraphDatabaseServices to
the same store in write mode this exception will be thrown.
Could it be that the time
Hi,
This could be a bug. Do you use the XA-framework
(org.neo4j.kernel.impl.transaction.xaframework) to register any
additional data sources?
If not this is a bug since the global transaction log finds an entry
with branch id "262374" and no data source has been registered for
that branch id. Wou
p in the middle of transactions and
>> > killing the jvm processes to test data integrity under unexpected
>> crashes.
>> > Despite this being a bug we are very happy with the outcome because as of
>> > today we have always been able to restart, and the worst cas
Hi,
On Fri, Feb 5, 2010 at 6:36 PM, Anton Popov wrote:
> Hello all,
>
> I'm still doing my tests on Neo4J. I've imported some data to Neo4J database
> & trying to search a shortest path search using Dijkstra implementation from
> neo4j-graph-algo package.
> As a result - I get exceptions & hanged
below:
>
> On 8 February 2010 11:15, Johan Svensson wrote:
>
>> Hi,
>>
>> How large heap have you set? I see that you have allocated 3G for
>> memory mapping that leaves about 512M max left for heap size since OS
>> (and other on OS processes) needs some mem
Hi,
On Wed, Feb 10, 2010 at 10:48 AM, Thomas Andersson
wrote:
> Hi,
> ...
> // don't do this
> synchronized void methodA()
> {
> nodeA.setProperty( "prop1", 1 );
> methodB();
> }
>
> synchronized void methodB()
> {
> nodeB.setProperty( "prop2", 2 );
> }
>
> According to the test, "The co
Hi,
Since we are throwing out possible solutions on how to do this I want
to mention the "graph-matching" component. The component needs an API
brushup and some documentation on how to use it (currently
non-existing...) but I think it should solve your problem nicely.
Here is a code example:
On Wed, Feb 10, 2010 at 2:35 PM, Dmitri Livotov wrote:
> Thanks for all your detailed responses. We now moved forward for stress
> testing it initial results shows a quite well performace, we're now
> running random reads, traversing and updates from 100 parallel threads
> and average response on
Hi,
Looks like a commit fails and then the TM tries to rollback the
transaction but that also fails. Only thing TM can do then is to block
all other running and new transactions from executing until the failed
transaction has been resolved. The strange thing is that the original
exception that cau
Friends,
After ten years of development, we are happy to finally announce the
release of Neo4j 1.0.
It's available here:
http://neo4j.org/download
http://dist.neo4j.org/neo4j-kernel-1.0-binary.zip
http://dist.neo4j.org/neo4j-kernel-1.0-binary.tar.gz
For the kernel component this releas
On Mon, Feb 15, 2010 at 7:20 PM, Dmitri Livotov wrote:
> By the way, is there any global L2 cache , based on heap in neo4j and
> can it be emptied manually ?
>
> We run another test with increased heap of 2G and 1G for memory mapped
> files. After 4 hours of testing, JVM reports from 100 to 200 M
nted/hidden API calls,
> as we'd like to create UI and ability to fine tune for as much db
> corners as possible from our system. (Being so tired on inability to
> control SQL databases well)
>
> Best,
> Dmitri
>
>
> Johan Svensson wrote:
>> On Mon, Feb 15, 20
Chris,
Sorry for long response time.
The pattern matcher can only match a single exact depth/pattern at the
moment. There is (currently) no way to configure it to match the way
you describe. Instead you would have to generate a pattern for each
depth meaning:
product-customer-product
product-cus
Ah now I understand. All the cache settings you are using in that
configuration are for the old cache and will have no effect on the
default soft reference based one. To tweak the soft reference based
one you need to tweak the JVM, here is an introduction:
http://jeremymanson.blogspot.com/2009/07/
Correct.
On Wed, Feb 17, 2010 at 12:54 PM, Dmitri Livotov wrote:
> Aha, thanks for the clarification,
> so is this correct, that for neo4j.properties we only need to consider
> configuring only the neostore.* properties ?
___
Neo mailing list
User@lists
untime Environment (build 1.6.0_16-b01)
> Java HotSpot(TM) 64-Bit Server VM (build 14.2-b01, mixed mode)
>
> apo...@mars:~$ uname -svr
> Linux 2.6.28-18-generic #59-Ubuntu SMP Thu Jan 28 01:40:19 UTC 2010
>
> On 8 February 2010 21:38, Johan Svensson wrote:
>
>> Hi Anton,
>&
Hi,
Another way would be to use the graph matching component. Have a look
at this thread:
http://lists.neo4j.org/pipermail/user/2010-February/002722.html
Regards,
-Johan
On Thu, Feb 18, 2010 at 8:49 AM, Raul Raja Martinez wrote:
> Hi Sumanth,
>
> You can have all your questions and answers be
Hi,
I think the easiest way would be for you to instrument the code in
org.neo4j.kernel.impl.core.NodeManager (check for nodeCache.get and
relCache.get calls).
Another way would be to let the application run the same
traversal/query many times in a row with different heap sizes. If
later iteratio
Hi,
Yes we are working on monitoring tools. Since transactions are held in
memory until committed larger transactions (containing many write
operations) will consume more memory. It would be possible to not keep
the full transaction in memory but that would kill read performance in
that transactio
Hi,
What is the error/problem you get when executing the program?
It is not a good idea to use all available RAM for the Java heap. Have
a look at http://wiki.neo4j.org/content/Configuration_Settings for
more information on how to configure Neo4j to make good use of
available RAM.
Regards,
-Joha
Hi,
You can not make such an ordered search using the Lucene indexing
service. You could try to only use a traverser instead of a Lucene
search and let the traverser do the filtering.
I am not sure I understand your problem completely. If you could
describe the problem in more detail I am sure we
Hi,
The last configuration for that store looks better. If you are doing
traversals and accessing properties for each hop on node/relationship
you need to increase the memory for the property store. If you are
requesting string properties you have to increase the size some there
too.
This may be
Hi,
Would it be possible to just traverse the friends looking for the
"neo4j" text on their profile? Like this:
Node user = // get the user;
Traverser trav = user.traverse( Order.BREADTH_FIRST,
new StopEvStopEvaluator.END_OF_GRAPH,
ReturnableEvaluator.ALL_BUT_START_NODE,
R
Hi,
Yes those files holds ids that can be reused. If you startup again and
create 310k nodes the id file will shrink and the db file will not
change in size.
Regards,
-Johan
2010/2/25 Miguel Ángel Águila :
> Helo,
> I'm doing a delete operation, in this case I'm deleting 310.000 nodes
> from 325
432 MB and after the
>> delete the database grown until 474 MB, also storing the indexes for
>> reusing later I think that it should decrease.
>>
>> I don't understand why works in this way.
>> Thanks.
>>
>> Mike
>>
>>
>> El jue, 25-02-2
If you store 322M strings (one string property/relationship), were
each string is 200 bytes, the string store will be 60GB+ in size.
How large are the strings you are storing?
-Johan
On Thu, Feb 25, 2010 at 2:55 PM, wrote:
> The string propertystore file seems really, really large to me, bas
quent calls should be a no-op?
>
> Adam
>
> On Wed, Feb 24, 2010 at 4:14 AM, Johan Svensson
> wrote:
>> Hi,
>>
>> Yes we are working on monitoring tools. Since transactions are held in
>> memory until committed larger transactions (containing many write
>>
Hi,
Could you give the full stacktrace and version of neo4j-kernel you are using.
Regards,
-Johan
On Fri, Feb 26, 2010 at 1:23 AM, Lyudmila L. Balakireva wrote:
> Hi,
> I am testing load of ntriples to the neo from files . I am using almost
> the same code I found in
> https://trac.neo4j.org/br
On Fri, Feb 26, 2010 at 2:27 AM, Satish Varma Dandu wrote:
> Hi John/nishith/Ulf,
> Thanks guys for all your replies.
>
> John,
> I was thinking about the same thing that you suggested. I havent yet
> constructed a huge n/w, but i was just curious how long will it take to
> traverse for 100K nod
Hi,
Can you reproduce this in a test case and send me the code?
If not I would need the active logical log that rotation fails at
(name of file is either called nioneo_logical.log.1 or
nioneo_logical.log.2).
Regards,
-Johan
On Fri, Feb 26, 2010 at 5:27 PM, Lyudmila L. Balakireva wrote:
> I am
Yes you should use the graph-matching component for this. Have a look
at this thread for more information:
http://lists.neo4j.org/pipermail/user/2010-February/002722.html
-Johan
On Wed, Mar 3, 2010 at 10:38 AM, Mattias Persson
wrote:
> This also seems like a case of finding paths from A to D...
Node/relationship setProperty( key, null ) will throw
IllegalArgumentException so you have to use the removeProperty( key )
method.
-Johan
On Wed, Mar 3, 2010 at 4:15 PM, Rick Bullotta
wrote:
> Perhaps a stupid question, but is setting a property to null effectively the
> same as deleting a prop
Hi,
Thanks for finding this since it is a bug. I have committed a fix for
it in kernel trunk.
Regards,
-Johan
On Fri, Mar 12, 2010 at 6:36 PM, Niels Hoogeveen
wrote:
>
> While loading data into the Neo4J database I got the following exception:
>
> Exception in thread "main"
> org.neo4j.kernel.
Hi Patrick,
Thanks for the feedback. I will have a look at this and implement
handling for disconnection and expiration of sessions.
Regarding the GC issues we are well aware of these (hopefully the new
"garbage first" or G1 GC will solve these problems). As you say the
concurrent mark sweep GC h
Hi,
The read only version is not faster on reads compared to a writable
store. Internally the only difference is we open files in read only
mode.
The reason you get the error is that your OS does not support to place
a memory mapped region to a file (opened in read only mode) when the
region maps
Hi,
I had a look at this and can not figure out why -1 is returned.
When running the kernel in normal (write) mode the return value of
number of ids in use will only be correct if all previous shutdowns
have executed cleanly. This is an optimization to reduce the time
spent in recovery rebuilding
Hi Marko,
We had a discussion around this today and conclusion was that we will
patch 1.1 very soon to support this. If there are no problems
(something we didn't think about) I would expect this to be in trunk
before end of month.
Regards,
-Johan
On Mon, Apr 5, 2010 at 8:15 AM, Marko Rodriguez
Code for this is now in trunk (neo4j-kernel 1.1-SNAPSHOT).
-Johan
On Tue, Apr 13, 2010 at 3:00 PM, Johan Svensson wrote:
> ...
> On Mon, Apr 5, 2010 at 8:15 AM, Marko Rodriguez wrote:
>> Hi,
>>
>> What is the timeframe for providing a GraphDatabaseService tha
On Tue, Apr 20, 2010 at 10:42 AM, Erik Ask wrote:
> Tobias Ivarsson wrote:
>> The speedup you are seeing is because of caching. Items that are used are
>> loaded into an in-memory structure, that does not need to go through any
>> filesystem API, memory-mapped or not. The best way to load things i
Hi,
There should be no problem to do multiple modifying operations in the
same transaction. Since you are talking about statements I take it you
are using the rdf component?
What happens if you move the delete statement before the call to Tx.success()?
Regards,
Johan
On Wed, Apr 14, 2010 at 5:5
Hi,
This code will shutdown the kernel right away. Depending on timing you
may shutdown the kernel while the thread pool is still executing and
that could be the cause of your error.
If you remove the @After / kernel shutdown code or add code in the
@Test method to wait for the thread pool to exe
On Thu, Apr 29, 2010 at 7:48 PM, Jon Noronha wrote:
> ...
>
> Is this a feature or a bug? All of the examples suggest that it's possible
> to read from the LuceneIndexBatchInserter, and indeed if I combine the code
> that creates the nodes and the index with the code that reads it into one
> file
Hi,
Adding a literal (with average size around ~400 bytes if the numbers
are correct) should not result in such a big difference of injection
times.
Could you give some more information regarding setup so we can track
down the cause of this. Good things to know would be:
o java version and jvm s
Hi,
I understand the graph layout as this:
(publisher node)<--PUBLISHED_BY---(book)<--BORROWED_BY--(student)
There are other relationships between books and students
(RETURNED_BY,RESERVED_BY) but the relationship count on a book node
will still be low compared to the publisher node. Correct?
On
Hi,
Have a look at org.neo4j.kernel.impl.nioneo.xa package. To implement a
new persistence source start by creating new implementations of the
NeoStoreXaDataSource and NeoStoreXaConnection classes. It is no longer
possible to swap in a different persistence source using configuration
(used to be)
Garrett,
This could be a bug. Could you please provide a test case that trigger
this behavior.
-Johan
On Sat, May 15, 2010 at 8:46 PM, Tobias Ivarsson
wrote:
> Create a ticket for it, I've tagged it for reviewing when I get back to the
> office, you had the great unfortune to send this right at
Alex,
How large heap and what configuration setting do you use? To inject
250M random relationships at highest possible speed would require at
least a 8GB heap with most of it assigned to the relationship store.
See
http://wiki.neo4j.org/content/Batch_Insert#How_to_configure_the_batch_inserter_pr
power supply died a few days ago so I'm waiting on a new one to
> arrive), so I only have 2GB of RAM. Heap is set to 1.5GB at the moment.
>
> Given my configuration is the performance I described typical?
>
> Alex
>
> On Tue, May 18, 2010 at 1:50 PM, Johan Svensson
>
ter a crash.
Regards,
Johan
>
> Thanks in advance,
> Jawad
>
> On Tue, May 18, 2010 at 1:22 PM, Johan Svensson
> wrote:
>
>> Hi,
>>
>> Have a look at org.neo4j.kernel.impl.nioneo.xa package. To implement a
>> new persistence source start by creating
Strings and arrays are lazy load so the property data will not be read
until you request it.
-Johan
On Thu, May 20, 2010 at 1:58 PM, Mattias Ask wrote:
> Hi,
>
> I was just wondering one thing. Are properties on Nodes and Relationships
> lazy loaded? I mean, if I have an AccountNode which holds
Hi,
I have not tried to reproduce this but just looking at the code I
think it is a bug so thanks for reporting it!
The "synchronization hook" that gathers the transaction data gets
registered in the call to GraphDatabaseService.beginTx() but when
using Spring (with that configuration) UserTransa
uld differ/degrade when using SSDs instead of
> old standard HDDs after RAM is saturated. Anyone have numbers?
>
> On Tue, May 18, 2010 at 8:30 AM, Johan Svensson
> wrote:
>
>> Working with a 250M relationships graph you need better hardware (more
>> RAM) to get good perf
Hi,
If your traversals access properties I would suggest full memory mapping:
neostore.nodestore.db.mapped_memory=1G
neostore.relationshipstore.db.mapped_memory=2G
neostore.propertystore.db.mapped_memory=1700M
neostore.propertystore.db.strings.mapped_memory=1200M
neostore.propertystore.db.arrays.
x27;m working on a lab environment ...
>
> Best regard,
> Lorenzo
>
>>
>>
>> On Fri, May 21, 2010 at 12:54 PM, Johan Svensson
>> wrote:
>>> Hi,
>>>
>>> If your traversals access properties I would
single
day on that machine.
-Johan
On Fri, May 21, 2010 at 1:15 PM, Lorenzo Livi wrote:
> No, I use only one jvm instance for each run.
> My run usually last something like 1 day or 15 days.
>
> On Fri, May 21, 2010 at 1:10 PM, Johan Svensson
> wrote:
>> Yes, -server is us
for ( TransactionEventHandler handler : this.handlers )
> @@ -55,6 +56,10 @@
> throw new RuntimeException( t );
> }
> }
> + } catch (Throwable th) {
> + th.printStackTrace();
> + throw new RuntimeException(th);
> + }
>
which I read about that to have the
> better performance.
>
>
>
> I did not look into previous posts of this emailing list, if you encounter
> such an issue before, please let me know where to look for the
> explanation/solution.
>
> In any case I am
act number of bytes of each store file for memory
mapped configuration.
Regards,
Johan
>
> Best regards,
> Lorenzo
>
>
> On Mon, May 24, 2010 at 11:41 AM, Johan Svensson
> wrote:
>> If a run is that long when performing traversals "-server" flag should
>>
Hi Tobias,
The problem here is that the machine has to little RAM to handle 244M
relationships without reading from disk.
What type of hard disk are you using? The low CPU usage and continuous
reads from disk indicate that cache misses are to high resulting in
many random reads from disk. I would
de properties
> in the TransactionData object? Since the transaction is commited (I
> guess finished), shouldn't I get an "NotInTransaction"
> exception?
>
> On 5/20/10 3:38 PM, Johan Svensson wrote:
>> Hi,
>>
>> I have not tried to reproduce t
Alex,
You are correct about the "holes" in the store file and I would
suggest you export the data and then re-import it again. Neo4j is not
optimized for the use case were more data is removed than added over
time.
It would be possible to write a compacting utility but since this is
not a very co
Rick,
There is no ordinary way to NOT run recovery on startup if the system
crashes. The only way for that to happen is if something extraneous to
Neo4j has modified the filesystem in between runs. For example if the
logical files are removed after a crash, then starting up could lead
to "no recov
1 - 100 of 350 matches
Mail list logo
