Thanks for the link Michael, tried CheckIndex: (1) It solves one problem with some (hopefully) minor losses by removing the corrupted index without having to delete the whole '/index' folder.
(2) However, I am not very sure if the tool only deletes the lucene index or also the underlying data the index refers to, as I was not very sure which entry in the database causes the problem.... It would be quite scary to imagine that some critical data have to be deleted or lose their index in production environment (although the next safety net would be the backups). Perhaps there is still a way to rebuild the whole index? In any case this is already a big step ahead, thanks alot!! Cheers, Rama On Sun, Sep 18, 2011 at 6:02 PM, Peter Neubauer < [email protected]> wrote: > Rama, > if you have good results with this, please report back and we can put > a link into the docs ... > > Cheers, > > /peter neubauer > > GTalk: neubauer.peter > Skype peter.neubauer > Phone +46 704 106975 > LinkedIn http://www.linkedin.com/in/neubauer > Twitter http://twitter.com/peterneubauer > > http://www.neo4j.org - Your high performance graph database. > http://startupbootcamp.org/ - Öresund - Innovation happens HERE. > http://www.thoughtmade.com - Scandinavia's coolest Bring-a-Thing party. > > > > On Sun, Sep 18, 2011 at 5:57 PM, Michael Hunger > <[email protected]> wrote: > > Perhaps this helps: > > > > CheckIndex is a tool available in the Lucene library, which allows you to > check the files and create new segments that do not contain problematic > entries. This means that this tool, with little loss of data is able to > repair a broken index. > > > > http://solr.pl/en/2011/01/17/checkindex-for-the-rescue/ > > > > > > Michael > > > > Am 18.09.2011 um 17:39 schrieb Mattias Persson: > > > >> I believe it is integrated (correct me if I'm wrong) but there might > still > >> be cases where i kill -9 or power outage might put some lucene files in > a > >> bad state. It's pretty much outside of neo4j's control and is very, very > >> rare. It'd be great to come up with some mechanism to be able to prevent > >> that, but for the time beimg I'm not aware of a way... Maybe there are > tools > >> for repairing a corrupted lucene index out there? > >> > >> Den lördagen den 17:e september 2011 skrev Peter Neubauer< > >> [email protected]>: > >>> Yes, > >>> messages.log is good, I am just not sure if in neo4j.rb Lucene is > >>> transactionally integrated at all, Andreas? > >>> > >>> Cheers, > >>> > >>> /peter neubauer > >>> > >>> GTalk: neubauer.peter > >>> Skype peter.neubauer > >>> Phone +46 704 106975 > >>> LinkedIn http://www.linkedin.com/in/neubauer > >>> Twitter http://twitter.com/peterneubauer > >>> > >>> http://www.neo4j.org - Your high performance graph > database. > >>> http://startupbootcamp.org/ - Öresund - Innovation happens HERE. > >>> http://www.thoughtmade.com - Scandinavia's coolest Bring-a-Thing > party. > >>> > >>> > >>> > >>> On Fri, Sep 16, 2011 at 7:34 PM, Rama Manusama < > [email protected]> > >> wrote: > >>>> Thanks Peter, Andreas, > >>>> > >>>> Yes I am running neo4j.rb with the newest version, and torquebox 1.1.1 > as > >>>> server > >>>> > >>>> I had a non-clean shutdown through ' kill -9 ' due to a Mechanize web > >>>> request process that took forever (strangely did not follow the > timeout > >>>> config due to some reason). I should not use kill -9 anymore I guess > >>>> > >>>> I also enclose messages.log if it would be useful/interesting for you > to > >> see > >>>> > >>>> > >>>> Perhaps Andreas could help with how index rebuilding works here? > Thanks > >>>> alot! > >>>> > >>>> Cheers, > >>>> > >>>> Rama > >>>> > >>>> > >>>> > >>>> On Fri, Sep 16, 2011 at 7:18 PM, Peter Neubauer < > >>>> [email protected]> wrote: > >>>> > >>>>> Mmh, > >>>>> so what did you do to get the index corrupted? Are you running > >>>>> neo4j.rb? In there, I am not sure that the Lucene index is integrated > >>>>> into the transactional system like in Neo4j java, so maybe Andreas > can > >>>>> shed some light? > >>>>> > >>>>> Cheers, > >>>>> > >>>>> /peter neubauer > >>>>> > >>>>> GTalk: neubauer.peter > >>>>> Skype peter.neubauer > >>>>> Phone +46 704 106975 > >>>>> LinkedIn http://www.linkedin.com/in/neubauer > >>>>> Twitter http://twitter.com/peterneubauer > >>>>> > >>>>> http://www.neo4j.org - Your high performance graph > >> database. > >>>>> http://startupbootcamp.org/ - Öresund - Innovation happens HERE. > >>>>> http://www.thoughtmade.com - Scandinavia's coolest Bring-a-Thing > party. > >>>>> > >>>>> > >>>>> > >>>>> On Fri, Sep 16, 2011 at 7:14 PM, Rama Manusama < > [email protected]> > >>>>> wrote: > >>>>>> Hi all, > >>>>>> > >>>>>> Sorry for a noobish question, my knowledge in Java is limited so > >> reading > >>>>> the > >>>>>> source is kinda difficult for me (I use neo4j.rb ruby binding v1.2.2 > >> and > >>>>>> neo4j 1.4) > >>>>>> > >>>>>> I ran into index corruption due to non-clean shutdown (through kill > >> -9) > >>>>> and > >>>>>> could not start the database anymore. Looking to discussions like > >>>>>> http://www.mail-archive.com/[email protected]/msg06100.html, I > >>>>> decided to > >>>>>> delete the index folder and it was solved. However I still need to > >>>>> rebuild > >>>>>> the index and have no clue on how to do this, have looked on the > docs > >> and > >>>>>> cannot really find either. Could anybody please help? > >>>>>> > >>>>>> I also posted my question here > >>>>>> > >>>>> > >> > http://stackoverflow.com/questions/7440244/how-to-rebuild-neo4j-lucene-index-neo4j-rb,but > >>>>>> neo4j activities seem to be low in stackoverflow > >>>>>> > >>>>>> Thanks all, appreciate your help!, > >>>>>> > >>>>>> Rama > >>>>>> _______________________________________________ > >>>>>> Neo4j mailing list > >>>>>> [email protected] > >>>>>> https://lists.neo4j.org/mailman/listinfo/user > >>>>>> > >>>>> _______________________________________________ > >>>>> Neo4j mailing list > >>>>> [email protected] > >>>>> https://lists.neo4j.org/mailman/listinfo/user > >>>>> > >>>> > >>>> > >>>> > >>>> -- > >>>> Rama John Gabriel Manusama > >>>> > >> > >> -- > >> Mattias Persson, [[email protected]] > >> Hacker, Neo Technology > >> www.neotechnology.com > >> _______________________________________________ > >> Neo4j mailing list > >> [email protected] > >> https://lists.neo4j.org/mailman/listinfo/user > > > > _______________________________________________ > > Neo4j mailing list > > [email protected] > > https://lists.neo4j.org/mailman/listinfo/user > > > _______________________________________________ > Neo4j mailing list > [email protected] > https://lists.neo4j.org/mailman/listinfo/user > -- Rama John Gabriel Manusama [email protected] _______________________________________________ Neo4j mailing list [email protected] https://lists.neo4j.org/mailman/listinfo/user
