prakharcode opened a new issue, #39954: URL: https://github.com/apache/airflow/issues/39954
### Description Sometime back AWS [launched](https://aws.amazon.com/blogs/aws/new-aws-dms-serverless-automatically-provisions-and-scales-capacity-for-migration-and-data-replication/) serverless DMS (Data Migration Service). This lets users create replication jobs without explicitly setting up a replication instance. Currently, in the AWS provider, we have support for classic DMS, which requires users to set up a [replication instance](https://github.com/prakharcode/airflow/blob/93ba263732a30ed51fdae0b2bff7cd959be115b8/airflow/providers/amazon/aws/operators/dms.py#L78). It would be nice, if we can provide dms serverless support using the following boto3 functions: - [create_replication_config](https://boto3.amazonaws.com/v1/documentation/api/latest/reference/services/dms/client/create_replication_config.html) - [describe-replication-configs](https://awscli.amazonaws.com/v2/documentation/api/latest/reference/dms/describe-replication-configs.html) - [describe-replications](https://awscli.amazonaws.com/v2/documentation/api/latest/reference/dms/describe-replications.html) - [start-replication](https://awscli.amazonaws.com/v2/documentation/api/latest/reference/dms/start-replication.html) - [stop-replication](https://awscli.amazonaws.com/v2/documentation/api/latest/reference/dms/stop-replication.html) - [delete-replication-config](https://awscli.amazonaws.com/v2/documentation/api/latest/reference/dms/delete-replication-config.html) ### Use case/motivation Giving airflow[aws] a serverless DMS option would unlock specific DMS use cases that are becoming increasingly common via serverless, like -- full-load of a new table and patching a CDC table using the full load on serverless. The serverless implementation is also quite appealing for source database replication that happens at a larger frequency than a couple of days (where a dedicated instance doesn't make sense) or with source data that changes or grows a lot. ### Related issues _No response_ ### Are you willing to submit a PR? - [X] Yes I am willing to submit a PR! ### Code of Conduct - [X] I agree to follow this project's [Code of Conduct](https://github.com/apache/airflow/blob/main/CODE_OF_CONDUCT.md) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
