[ https://issues.apache.org/jira/browse/GSOC-276?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Mingyang Liu updated GSOC-276: ------------------------------ Description: h2. Backgroud: Kvrocks is a key-value database that provides a Redis-compatible API on top of RocksDB. Currently, Kvrocks lacks a built-in mechanism for database backup to cloud storage, which is crucial for data durability, disaster recovery, and scalability in cloud environments. This project aims to implement a robust backup system that allows users to store Kvrocks backups directly in cloud storage services such as Amazon S3, Google Cloud Storage, and/or Azure Blob Storage. The solution will integrate with the existing Kvrocks backup and restore mechanisms while ensuring efficient and secure data transfer. h2. Deliverables: # *Cloud Storage Integration:* Implement backup storage support for Amazon S3, Google Cloud Storage, and Azure Blob Storage using SDKs, REST APIs or libraries (e.g. Apache OpenDAL). # *Backup & Restore Commands:* Extend Kvrocks’ backup functionality to allow exporting and importing database snapshots from cloud storage. # *Configuration & Authentication:* Provide user-configurable options to specify storage credentials and backup parameters. # *Incremental Backup Support (Stretch Goal):* Optimize storage usage by implementing differential or incremental backup capabilities. # *Documentation & Tests:* Comprehensive documentation and test coverage to ensure reliability and ease of use. h2. Recommended Skills: # Good at coding in C++; # Knowledge about database internals and cloud storage; # Knowledge about Kvrocks or Redis. Mentor: Mingyang Liu, Apache Kvrocks PMC member, tw...@apache.org Mailing List: d...@kvrocks.apache.org was: h2. Backgroud: Kvrocks is a key-value database that provides a Redis-compatible API on top of RocksDB. Currently, Kvrocks lacks a built-in mechanism for database backup to cloud storage, which is crucial for data durability, disaster recovery, and scalability in cloud environments. This project aims to implement a robust backup system that allows users to store Kvrocks backups directly in cloud storage services such as Amazon S3, Google Cloud Storage, and/or Azure Blob Storage. The solution will integrate with the existing Kvrocks backup and restore mechanisms while ensuring efficient and secure data transfer. h2. Deliverables: # *Cloud Storage Integration:* Implement backup storage support for Amazon S3, Google Cloud Storage, and Azure Blob Storage using SDKs, REST APIs or libraries (e.g. Apache OpenDAL). # *Backup & Restore Commands:* Extend Kvrocks’ backup functionality to allow exporting and importing database snapshots from cloud storage. # *Configuration & Authentication:* Provide user-configurable options to specify storage credentials and backup parameters. # *Incremental Backup Support (Stretch Goal):* Optimize storage usage by implementing differential or incremental backup capabilities. # *Documentation & Tests:* Comprehensive documentation and test coverage to ensure reliability and ease of use. h2. Recommended Skills: # Good at coding in C++; # Knowledge about database internals and cloud storage; # Knowledge about Kvrocks or Redis. > [GSOC][Kvrocks] Support database backup to cloud storage > -------------------------------------------------------- > > Key: GSOC-276 > URL: https://issues.apache.org/jira/browse/GSOC-276 > Project: Comdev GSOC > Issue Type: New Feature > Reporter: Mingyang Liu > Priority: Major > > h2. Backgroud: > Kvrocks is a key-value database that provides a Redis-compatible API on top > of RocksDB. Currently, Kvrocks lacks a built-in mechanism for database backup > to cloud storage, which is crucial for data durability, disaster recovery, > and scalability in cloud environments. > This project aims to implement a robust backup system that allows users to > store Kvrocks backups directly in cloud storage services such as Amazon S3, > Google Cloud Storage, and/or Azure Blob Storage. The solution will integrate > with the existing Kvrocks backup and restore mechanisms while ensuring > efficient and secure data transfer. > h2. Deliverables: > # *Cloud Storage Integration:* Implement backup storage support for Amazon > S3, Google Cloud Storage, and Azure Blob Storage using SDKs, REST APIs or > libraries (e.g. Apache OpenDAL). > # *Backup & Restore Commands:* Extend Kvrocks’ backup functionality to allow > exporting and importing database snapshots from cloud storage. > # *Configuration & Authentication:* Provide user-configurable options to > specify storage credentials and backup parameters. > # *Incremental Backup Support (Stretch Goal):* Optimize storage usage by > implementing differential or incremental backup capabilities. > # *Documentation & Tests:* Comprehensive documentation and test coverage to > ensure reliability and ease of use. > h2. Recommended Skills: > # Good at coding in C++; > # Knowledge about database internals and cloud storage; > # Knowledge about Kvrocks or Redis. > Mentor: Mingyang Liu, Apache Kvrocks PMC member, tw...@apache.org > Mailing List: d...@kvrocks.apache.org -- This message was sent by Atlassian Jira (v8.20.10#820010) --------------------------------------------------------------------- To unsubscribe, e-mail: gsoc-unsubscr...@community.apache.org For additional commands, e-mail: gsoc-h...@community.apache.org