keith-turner opened a new pull request, #4109: URL: https://github.com/apache/accumulo/pull/4109
The custom refresh tracking code was removed and compaction commit was moved to being a FATE operation with the following 4 steps. 1. Rename file done in RenameCompactionFile class 2. Update the metadata table via a conditional mutation done in CommitCompaction class 3. Write the gc candidates done in PutGcCandidates class 4. Optionally send a RPC refresh request if the tablet was hosted done in RefreshTablet class There is some follow on work that still needs to be done to improve how this change works with detecting dead compactions. After that is done these changes should address problems outlined #3811 and #3802 that were related to process death before adding GC candidates. Now that GC candidates are written in FATE, if it dies it will run again later. This is currently storing the compaction commit FATE operations in zookeeper. This would not be suitable for a cluster because per tablet information should never be stored in zookeeper. However its fine as a temporary situation in the elasticity branch until FATE storage is availabe in an accumulo table, see #4049 and #3559 WIP WIP WIP -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: notifications-unsubscr...@accumulo.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org