danny0405 opened a new pull request, #13285:
URL: https://github.com/apache/hudi/pull/13285
### Change Logs
The new instant time generation utilizes RPC request to coordinate creation
of new instants. Each write task will send a RPC request to the coordinator for
the instant time, the coordinator uses a global lock to guard the access from
multiple tasks.
Now one checkpoint id corresponds to one instant.
Basic work flow:
* write task send request: current ckp id
* write task expected response: the instant time
* coordinator mappings of checkpoint and instant: ckp-id → {instant →
{write-task-id → write meta event}}
Note that the ckp id used in the request is the last known id instead of the
current checkpoint, for job restored from a state, it is the state checkpoint
id, otherwise -1 for fresh new job.
### Impact
none
### Risk level (write none, low medium or high below)
low
### Documentation Update
none
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
