lokeshj1703 commented on PR #17970:
URL: https://github.com/apache/hudi/pull/17970#issuecomment-4044454048
@nsivabalan These can be used as commit message.
Short commit message:
Add support for StorageBasedLockProvider
Detailed commit message:
Option 1:
These changes add storage-based lock provider support including:
- New StorageBasedLockProvider with S3 and GCS implementations
- Heartbeat task manager for lock provider using conditional writes
- Metrics and audit logging for storage-based lock provider
- Config rename from hoodie.write.lock.storage.heartbeat.poll.secs to
hoodie.write.lock.storage.renew.interval.secs
Option 2:
Improvements:
- [HUDI-9158] Add conditional write lock provider base logic/class
- [HUDI-9156] Add heartbeat task manager for lock provider using
conditional writes
- [HUDI-9159] Add ConditionalWriteLockService implementation for S3
- [HUDI-9160] Add ConditionalWriteLockService implementation for GCS
- [HUDI-9742] Emit lock metrics when releasing lock
- [HUDI-9752] Add metrics for storage-based lock provider
- [HUDI-9782] Add audit logging for storage-based lock provider
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
