keith-turner opened a new pull request, #4109:
URL: https://github.com/apache/accumulo/pull/4109
The custom refresh tracking code was removed and compaction commit was moved
to being a FATE operation with the following 4 steps.
1. Rename file done in RenameCompactionFile class
2. Update the metadata table via a conditional mutation done in
CommitCompaction class
3. Write the gc candidates done in PutGcCandidates class
4. Optionally send a RPC refresh request if the tablet was hosted done in
RefreshTablet class
There is some follow on work that still needs to be done to improve how this
change works with detecting dead compactions. After that is done these changes
should address problems outlined #3811 and #3802 that were related to process
death before adding GC candidates. Now that GC candidates are written in FATE,
if it dies it will run again later.
This is currently storing the compaction commit FATE operations in
zookeeper. This would not be suitable for a cluster because per tablet
information should never be stored in zookeeper. However its fine as a
temporary situation in the elasticity branch until FATE storage is availabe in
an accumulo table, see #4049 and #3559
WIP
WIP
WIP
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
