Yeah, I'm inserting stuff into an index as you say and I always shutdown the BatchInserterIndexProvider prior to the inserter shutdown. I have to say that I'm a bit confused about all these exceptions and don't know what I could be doing wrong. I put another question regarding indexer and callings to optimize() method, which has been the reason for my last problem. Cheers
Pablo On Tue, Feb 15, 2011 at 8:44 AM, Mattias Persson <[email protected]>wrote: > It looks to me that you're inserting stuff into an index as well, > http://wiki.neo4j.org/content/Index_Framework#Batch_insertion right? If > you > do that you'll have to call shutdown on that BatchInserterIndexProvider on > conjunction with shutting down the BatchInserter. > > 2011/2/14 Pablo Pareja <[email protected]> > > > Yeah, that's what I thought, I just wanted to confirm it. > > Thanks > > > > Pablo > > > > On Mon, Feb 14, 2011 at 4:57 PM, Tobias Ivarsson < > > [email protected]> wrote: > > > > > BatchInserter.shutdown() is synchronous, it has to be, otherwise it > > > wouldn't > > > be safe at all. > > > After shutdown() has returned it guarantees that all store files have > > been > > > written, and are in a consistent state. > > > > > > -t > > > > > > On Mon, Feb 14, 2011 at 4:01 PM, Pablo Pareja <[email protected]> > wrote: > > > > > > > Great, thanks for the information. > > > > Just out of curiosity then, are calls to BatchInserter.shutdown() > sync > > or > > > > asynchronous ? > > > > I mean, does the program flow stops in that call till every operation > > the > > > > shutdown implies has been > > > > performed? > > > > Cheers, > > > > > > > > Pablo > > > > > > > > On Mon, Feb 14, 2011 at 3:30 PM, Tobias Ivarsson < > > > > [email protected]> wrote: > > > > > > > > > The batch inserter will write data to disk as needed. The memory > > mapped > > > > > regions are used to speed up writes, so that the API level writes > can > > > be > > > > > done to the memory mapped regions which can then be written in > large > > > > > sequential chunks to disk. > > > > > > > > > > You do not have to shut down the batch inserter for this to happen, > > it > > > is > > > > > taken care of automatically. > > > > > > > > > > Cheers, > > > > > Tobias > > > > > > > > > > On Mon, Feb 14, 2011 at 10:53 AM, Pablo Pareja <[email protected]> > > > wrote: > > > > > > > > > > > Hi, > > > > > > > > > > > > I was wondering whether once the memory-mapping configuration for > > > > > > BatchInserter is full *(for example* > > > > > > *in the case of neostore.relationshipstore.db.mapped_memory) > *the > > > > class > > > > > > would auto-commit these changes > > > > > > to disk or it would just throw an exception. > > > > > > In the latter case, what would the options be? > > > > > > > > > > > > In my case I have to insert a huge amount of data that cannot be > > > > > allocated > > > > > > in RAM. > > > > > > First I thought the BatchInserter would deal with this kind of > > > > situation, > > > > > > however I keep getting exceptions whenever the > > > > > > program reaches the point where *(I guess) *memory mapping > > > > configuration > > > > > is > > > > > > not enough. > > > > > > > > > > > > Since I cannot use more RAM than what I have, I thought, ok so I > > will > > > > > > shutdown both inserter and index service and > > > > > > create them again each time the program have already inserted a > > > decent > > > > > > amount of data. > > > > > > Then, don't know why but after a couple of tests, at some point > the > > > > > program > > > > > > always halts throwing a really weird exception > > > > > > saying something about a index file that exists but cannot be > > > accessed > > > > in > > > > > > the merge process ?!? > > > > > > > > > > > > I guess I'd be doing something wrong but cannot figure out what > it > > > is. > > > > > > Thanks in advance > > > > > > > > > > > > -- > > > > > > Pablo Pareja Tobes > > > > > > LinkedIn http://www.linkedin.com/in/pabloparejatobes > > > > > > Twitter http://www.twitter.com/pablopareja > > > > > > > > > > > > http://www.ohnosequences.com > > > > > > _______________________________________________ > > > > > > Neo4j mailing list > > > > > > [email protected] > > > > > > https://lists.neo4j.org/mailman/listinfo/user > > > > > > > > > > > > > > > > > > > > > > > > > > -- > > > > > Tobias Ivarsson <[email protected]> > > > > > Hacker, Neo Technology > > > > > www.neotechnology.com > > > > > Cellphone: +46 706 534857 > > > > > _______________________________________________ > > > > > Neo4j mailing list > > > > > [email protected] > > > > > https://lists.neo4j.org/mailman/listinfo/user > > > > > > > > > > > > > > > > > > > > > -- > > > > Pablo Pareja Tobes > > > > LinkedIn http://www.linkedin.com/in/pabloparejatobes > > > > Twitter http://www.twitter.com/pablopareja > > > > > > > > http://www.ohnosequences.com > > > > _______________________________________________ > > > > Neo4j mailing list > > > > [email protected] > > > > https://lists.neo4j.org/mailman/listinfo/user > > > > > > > > > > > > > > > > -- > > > Tobias Ivarsson <[email protected]> > > > Hacker, Neo Technology > > > www.neotechnology.com > > > Cellphone: +46 706 534857 > > > _______________________________________________ > > > Neo4j mailing list > > > [email protected] > > > https://lists.neo4j.org/mailman/listinfo/user > > > > > > > > > > > -- > > Pablo Pareja Tobes > > LinkedIn http://www.linkedin.com/in/pabloparejatobes > > Twitter http://www.twitter.com/pablopareja > > > > http://www.ohnosequences.com > > _______________________________________________ > > Neo4j mailing list > > [email protected] > > https://lists.neo4j.org/mailman/listinfo/user > > > > > > -- > Mattias Persson, [[email protected]] > Hacker, Neo Technology > www.neotechnology.com > _______________________________________________ > Neo4j mailing list > [email protected] > https://lists.neo4j.org/mailman/listinfo/user > -- Pablo Pareja Tobes LinkedIn http://www.linkedin.com/in/pabloparejatobes Twitter http://www.twitter.com/pablopareja http://www.ohnosequences.com _______________________________________________ Neo4j mailing list [email protected] https://lists.neo4j.org/mailman/listinfo/user
