keith-turner commented on PR #3639: URL: https://github.com/apache/accumulo/pull/3639#issuecomment-1645985243
I added merge, bulk import, compaction filtering, and batch scan to the test in 7cbc635. I also added some debugging tips based on a problem I ran into where bulk importing deletes was causing the test to fail. Spent hours trying to track down the cause and finally developed a technique that made tracking the problem down really quick. I documented the technique [in the code](https://github.com/apache/accumulo/blob/7cbc6356fecb569a713094dba779f5e54c9301c9/test/src/main/java/org/apache/accumulo/test/ScanConsistencyIT.java#L93-L108) and left a [utility method](https://github.com/apache/accumulo/blob/7cbc6356fecb569a713094dba779f5e54c9301c9/test/src/main/java/org/apache/accumulo/test/ScanConsistencyIT.java#L668-L696) related to the technique in the test. The problem I ran into is documented [here in the test](https://github.com/apache/accumulo/blob/7cbc6356fecb569a713094dba779f5e54c9301c9/test/src/main/java/org/apache/accumulo/test/ScanConsistencyIT.java#L488-L496). The problem is caused by the fact that major compactions no longer force a flush, this is a change made some time in the past, trying to find an issue for that. Not flushing before a full major compaction is ok when only doing live ingest or only doing bulk import, but for a mix of bulk import and live ingest not flushing before full major compaction has a consequence as I discovered in the test. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
