abhinavraj23 opened a new issue #22016:
URL: https://github.com/apache/airflow/issues/22016


   ### Description
   
   For the airflow operators made corresponding to [google cloud storage 
transfer service](https://cloud.google.com/storage-transfer-service), there 
isn't any operator available to directly run a pre-configured transfer job. The 
storage transfer service provides the API for this use case, here the 
[link](https://cloud.google.com/storage-transfer/docs/reference/rest/v1/transferJobs/run)
 to the API. Corresponding to this API an operator can be added to 
[cloud_storage_transfer_service.py](https://github.com/apache/airflow/blob/main/airflow/providers/google/cloud/operators/cloud_storage_transfer_service.py)
   
   ### Use case/motivation
   
   There's a quota limit in transfer job creation, which is that one can only 
create at max 1000 transfer job/day, but there isn't any quota on running an 
already created transfer job, in such a case updating a preconfigured transfer 
job and running it would be a recurring use case for data pipelines and thus 
this operator would be helpful
   
   ### Related issues
   
   _No response_
   
   ### Are you willing to submit a PR?
   
   - [X] Yes I am willing to submit a PR!
   
   ### Code of Conduct
   
   - [X] I agree to follow this project's [Code of 
Conduct](https://github.com/apache/airflow/blob/main/CODE_OF_CONDUCT.md)
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]


Reply via email to