I am using version 2.0 (both server and batch-import).
Altought I now see after running the batch-importer that it got an
exception on shutting down (it was in the shutdown phase for about 2h when
importing 78M nodes). The time could be that i ran it with the
configuration that came with the download.
The exception is as follows:
G:\batch-import-20>import.bat ../Neo4j/db ../CSV/Node_Author.csv
Usage: Importer data/dir nodes.csv relationships.csv [node_index
node-index-name fulltext|exact nodes_index.csv rel_inde
x rel-index-name fulltext|exact rels_index.csv ....]
Using: Importer ../Neo4j/db ../CSV/Node_Author.csv
Using Existing Configuration File
....................................................................................................
140480 ms for 10000
000
....................................................................................................
162812 ms for 10000
000
....................................................................................................
173473 ms for 10000
000
....................................................................................................
186817 ms for 10000
000
....................................................................................................
188060 ms for 10000
000
....................................................................................................
192955 ms for 10000
000
....................................................................................................
158847 ms for 10000
000
........................................................................................
Importing 78819880 Nodes took 1327 seconds
Exception in thread "main"
org.neo4j.kernel.impl.nioneo.store.UnderlyingStorageException: Unable to
close store G:\batch
-import-20\..\Neo4j\db\neostore.propertystore.db.strings
at
org.neo4j.kernel.impl.nioneo.store.CommonAbstractStore.close(CommonAbstractStore.java:603)
at
org.neo4j.kernel.impl.nioneo.store.PropertyStore.closeStorage(PropertyStore.java:122)
at
org.neo4j.kernel.impl.nioneo.store.CommonAbstractStore.close(CommonAbstractStore.java:546)
at
org.neo4j.kernel.impl.nioneo.store.NeoStore.closeStorage(NeoStore.java:254)
at
org.neo4j.kernel.impl.nioneo.store.CommonAbstractStore.close(CommonAbstractStore.java:546)
at
org.neo4j.unsafe.batchinsert.BatchInserterImpl.shutdown(BatchInserterImpl.java:1062)
at org.neo4j.batchimport.Importer.finish(Importer.java:88)
at org.neo4j.batchimport.Importer.doImport(Importer.java:239)
at org.neo4j.batchimport.Importer.main(Importer.java:83)
Caused by: java.io.IOException: The requested operation cannot be performed
on a file with a user-mapped section open
at sun.nio.ch.FileDispatcherImpl.truncate0(Native Method)
at sun.nio.ch.FileDispatcherImpl.truncate(Unknown Source)
at sun.nio.ch.FileChannelImpl.truncate(Unknown Source)
at
org.neo4j.kernel.impl.nioneo.store.CommonAbstractStore.close(CommonAbstractStore.java:583)
... 8 more
Configuration:
use_memory_mapped_buffers=true
neostore.nodestore.db.mapped_memory=100M
neostore.relationshipstore.db.mapped_memory=500M
neostore.propertystore.db.mapped_memory=1G
neostore.propertystore.db.strings.mapped_memory=200M
neostore.propertystore.db.arrays.mapped_memory=0M
neostore.propertystore.db.index.keys.mapped_memory=15M
neostore.propertystore.db.index.mapped_memory=15M
batch_import.csv.quotes=false
I am also using
i:id
and one
type:label
other each node has 7 properties.
Thanx in advance!
On Friday, January 10, 2014 1:20:39 PM UTC+1, Michael Hunger wrote:
>
> Which version are you using?
>
> I think this is solved in 2.0
>
> The index / label store population is there moved to batchinserter-shutdown
>
> Sent from mobile device
>
> Am 10.01.2014 um 13:10 schrieb Johannes Tveitan
> <[email protected]<javascript:>
> >:
>
> Hi,
>
> the problem I am facing is that when I create a new DB file with the
> batch-import tool and then tries to start the Neo4j Server, it takes an
> enormous amount of time to start. The last time I did this I importer about
> 78M nodes and aborted the starting of the server after 3h of it trying to
> start. It gets to the point of saying "In just a few seconds, Neo4j will be
> ready...", on the windows version and the same stage on the linux version.
> It is at this stage i killed the application after 3h.
>
> Any ideas? Does it just take a really long time or is something obviously
> wrong?
>
> --
> You received this message because you are subscribed to the Google Groups
> "Neo4j" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to [email protected] <javascript:>.
> For more options, visit https://groups.google.com/groups/opt_out.
>
>
--
You received this message because you are subscribed to the Google Groups
"Neo4j" group.
To unsubscribe from this group and stop receiving emails from it, send an email
to [email protected].
For more options, visit https://groups.google.com/groups/opt_out.
