Hi there, On Tue, Nov 15, 2011 at 6:50 PM, vistorve <ayuskaus...@compete.com> wrote: > I setup visualvm with a jmx connection to the server running neo4j I wasn't > able to CPU profiling working, it had an error message saying > getThreadCpuTime was expecting long but got something else. I do have thread > and heap dumps though if those would be useful. Would like to see the error here, might be a bug?
> > When I was running the batch upload I saw that the CPU usage never went over > one core ~15% total cpu usage. > > Also I noticed that when I did a batch job of 1.5k nodes, 3k relationships > the network usage would spike and be consistent and then fall for the upload > and then spike and fall again for the read back from the server. However > when I did 15k nodes and 30k relationships the network would spike, fall and > then have short regular spike of only a couple KB/s. Is there some internal > paging going on with the REST server, why doesn't it transfer the file all > at once and then process it? > I think there might be something happening internally, maybe a GC, before continuing to read the input stream from the socket. However, can't see that in the code, it's probably best to get a testcase from you on this? > The 1.5k job took about 25 seconds, the 15k job took 1220 seconds. > > Below is the configuration I have for the server, the machine itself has > 32GB of ram and 8 64bit cores: > -XX:+DisableExplicitGC > -XX:+UseParallelGC > -XX:+UseNUMA > -Xss1024m > -Xms2048m > -Xmx4056m > > Neo4j properties: > neostore.nodestore.db.mapped_memory=300M > neostore.relationshipstore.db.mapped_memory=600M > neostore.propertystore.db.mapped_memory=600M > neostore.propertystore.db.strings.mapped_memory=1024M > neostore.propertystore.db.arrays.mapped_memory=1024M > cache_type=strong > use_memory_mapped_buffers=false > > > -- > View this message in context: > http://neo4j-community-discussions.438527.n3.nabble.com/Neo4j-Batch-uploading-to-REST-server-tp3477770p3510431.html > Sent from the Neo4j Community Discussions mailing list archive at Nabble.com. > _______________________________________________ > Neo4j mailing list > User@lists.neo4j.org > https://lists.neo4j.org/mailman/listinfo/user > _______________________________________________ Neo4j mailing list User@lists.neo4j.org https://lists.neo4j.org/mailman/listinfo/user
