WTa-hash edited a comment on issue #4241: URL: https://github.com/apache/hudi/issues/4241#issuecomment-993845354
Thanks @kazdy for your input. I read the documentation for AWS Backup and S3 support. Based on the documentation, I am assuming we can do the following (using the us-east-1 issue that occurred on 2021-DEC-7): FAILURE SCENARIO: 1. Create a backup of Hudi Datalake S3 bucket on us-east-1 using AWS Backup and create a copy of that in region X. 2. When us-east-1 failure/issue occurs, then restore Hudi Datalake S3 bucket backup (created from us-east-1) into a different S3 bucket in region X. FALLBACK SCENARIO (when us-east-1 is stable again): 1. Create a backup of Hudi Datalake S3 bucket on region X using AWS Backup and create a copy of that in us-east-1. 2. When ready to fallback to us-east-1, then restore Hudi Datalake S3 bucket backup (created from region X) into a S3 bucket in us-east-1. Sounds like above scenario should work - won't be able to test this until AWS Backup for S3 is generally available. We can probably do something similar if we need to failover/fallback between different AWS accounts since AWS Backup supports cross region and cross account. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
