fapifta opened a new pull request #1456:
URL: https://github.com/apache/hadoop-ozone/pull/1456


   ## What changes were proposed in this pull request?
   
   Server side implementation of the finalization logic is implemented in this 
pull request.
   The initial idea in the client side implementation is to issue an initiating 
request, then monitor the process with client side polling.
   This is reflected in the server side code, but due to complications, in the 
server side, the background finalization of layoutfeatures one by one, is 
postponed and tracked in HDDS-4286.
   The problem with the backround finalization is that it has to be synced 
between the OMs, and we need to ensure that once requests are in the state 
machine for finalizing a layout feature, the requests processed by the master 
before the finalization requests, and after the finalization requests are in 
sync and in order.
   This means that we need to post separate requests into the state machine 
internally on the leader OM, to have a flow, where the a specific request type 
or change to a request handling, once its activated, it is on all OMs activated 
at the same transaction. We do not really have such a logic for now, and it 
requires some further review. I will post a design doc on this one into 
HDDS-4286 in the near future about possible solutions.
   
   With that, in this patch, the finalization of the features is happening 
inside the initiating UpgradeFinalizeRequest RPC call handling, and it has to 
finish on at least two OMs. So we process the finalization inside the 
statemachine in one batch.
   After this, the client gets a STARTING_FINALIZATION status back, and after 
the 500ms delay on the client side, the client will grab the results.
   
   ## What is the link to the Apache JIRA
   https://issues.apache.org/jira/browse/HDDS-4172
   
   ## How was this patch tested?
   
   Quick manual test for the very basic workflow so far.
   JUnit tests to be added to the PR, but wanted to share to have reviews on 
the approach while I am working on the tests.
   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: ozone-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: ozone-issues-h...@hadoop.apache.org

Reply via email to