Thanks for the information. I'll give it a try this weekend and let you know what I find. What's the best error/trace information to provide for both the backup failure case and the consistency check failure case?
On Wednesday, February 4, 2015 at 5:55:42 AM UTC-8, fitcs wrote: > > I suspect you are seeing a false positive from the consistency check run > during an incremental. There is an option to not do the check ( -verify > false ) and the do a full consistency check on the backup store. > > Full consistency check tuning and more details of these options are > covered in Mark's blog: > > ``` > > http://www.markhneedham.com/blog/2014/01/22/neo4j-backup-store-copy-and-consistency-check/ > ``` > > If you could provide the error/trace from your experience it will help > with the repro. It would also be good to know if it is not a false > positive i.e. if the full check identifies an issue. > > Thanks, > > John @ Neo4j. > > > > On Tuesday, February 3, 2015 at 4:50:54 PM UTC-5, [email protected] > wrote: >> >> I'm also seeing this issue on 2.1.6. I'm running backups every 15 >> minutes and after about 10 hours the incremental starts failing. Deleting >> the backup and starting again with a full seems to fix the issue. Is this >> going to be addressed soon? Being able to create reliable backups is pretty >> crucial in a production environment. >> >> >> >> On Thursday, January 29, 2015 at 3:03:33 PM UTC-8, Jeremy Kitchen wrote: >>> >>> On Friday, November 28, 2014 at 3:42:53 AM UTC-8, Mark Findlater wrote: >>>> >>>> Yesterday Stefan Armbruster kindly helped me with an issue (on >>>> StackOverflow >>>> <http://stackoverflow.com/questions/27151590/neo4j-2-1-5-incremental-backup-fails-but-full-backup-succeeds>) >>>> >>>> where my backups were reporting as inconsistent. Upgrading Neo to 2.1.6 >>>> and >>>> Stefan running some dedupe process required to fix data corrupted by a >>>> previous version of Neo did seem to rectify the problem. However having >>>> run >>>> for a few hours the partial backups have started failing again: >>>> >>>> Exception in thread "main" org.neo4j.consistency. >>>> ConsistencyCheckingError: Inconsistencies in transaction: >>>> Start[3,xid=GlobalId[NEOKERNL|-467164560916179351|986|-1], >>>> BranchId[ 52 49 52 49 52 49 ],master=-1,me=-1,time=2014-11-27 17:45: >>>> 00.073+0000/1417110300073,lastCommittedTxWhenTransactionStarted=29226] >>>> 2PC[3, txId=29227, 2014-11-27 17:45:00.141+0000/1417110300141] >>>> ConsistencySummaryStatistics{ >>>> Number of errors: 1 >>>> Number of warnings: 0 >>>> Number of inconsistent NODE records: 1 >>>> } >>>> >>> >>> >>> I am also running into this issue with 2.1.6 on ubuntu 12.04. If it >>> makes any difference, the filesystem I'm dumping to is being served by a >>> netapp over nfs. >>> >>> $ /usr/bin/neo4j-backup -host localhost -to /mnt/neo4j_backups/dump >>> Performing backup from '127.0.0.1:6362' >>> Transactions applied >>> Exception in thread "main" org.neo4j.consistency. >>> ConsistencyCheckingError: Inconsistencies in transaction: >>> Start[3,xid=GlobalId[NEOKERNL|723968400398398807|26298|540], BranchId[ >>> 52 49 52 49 52 49 ],master=540,me=540,time=2015-01-29 20:46:55.441+0000/ >>> 1422564415441,lastCommittedTxWhenTransactionStarted=99274] >>> 1PC[3, txId=99275, 2015-01-29 20:46:55.443+0000/1422564415443] >>> ConsistencySummaryStatistics{ >>> Number of errors: 1 >>> Number of warnings: 0 >>> Number of inconsistent RELATIONSHIP records: 1 >>> } >>> at org.neo4j.consistency.checking.incremental.intercept. >>> CheckingTransactionInterceptor.complete(CheckingTransactionInterceptor. >>> java:181) >>> at org.neo4j.kernel.impl.transaction.xaframework.LogEntryVisitorAdapter >>> .apply(LogEntryVisitorAdapter.java:62) >>> at org.neo4j.kernel.impl.transaction.xaframework.LogEntryVisitorAdapter >>> .apply(LogEntryVisitorAdapter.java:28) >>> at org.neo4j.kernel.impl.nioneo.xa.command.LogFilter.endLog(LogFilter. >>> java:87) >>> at org.neo4j.kernel.impl.transaction.xaframework.XaLogicalLog. >>> applyTransaction(XaLogicalLog.java:1121) >>> at org.neo4j.kernel.impl.transaction.xaframework.XaResourceManager. >>> applyCommittedTransaction(XaResourceManager.java:866) >>> at org.neo4j.kernel.impl.transaction.xaframework.XaDataSource. >>> applyCommittedTransaction(XaDataSource.java:246) >>> at org.neo4j.com.ServerUtil.applyReceivedTransactions(ServerUtil.java: >>> 461) >>> at org.neo4j.backup.BackupService.unpackResponse(BackupService.java:423 >>> ) >>> at org.neo4j.backup.BackupService.incrementalWithContext(BackupService. >>> java:330) >>> at org.neo4j.backup.BackupService.doIncrementalBackup(BackupService. >>> java:269) >>> at org.neo4j.backup.BackupService.doIncrementalBackup(BackupService. >>> java:222) >>> at org.neo4j.backup.BackupService.doIncrementalBackupOrFallbackToFull( >>> BackupService.java:243) >>> at org.neo4j.backup.BackupTool.doBackup(BackupTool.java:225) >>> at org.neo4j.backup.BackupTool.executeBackup(BackupTool.java:189) >>> at org.neo4j.backup.BackupTool.runBackup(BackupTool.java:180) >>> at org.neo4j.backup.BackupTool.run(BackupTool.java:134) >>> at org.neo4j.backup.BackupTool.main(BackupTool.java:90) >>> >>> >>> >>> >>> Thanks! >>> >>> -Jeremy >>> >> -- You received this message because you are subscribed to the Google Groups "Neo4j" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. For more options, visit https://groups.google.com/d/optout.
