pwachira opened a new issue #21139:
URL: https://github.com/apache/airflow/issues/21139


   ### Description
   
   Create a trigger for deferrable operators that uses a websocket client to 
send a long-lived/long-running task request to an external remote websocket 
server that handles (or intiates the handling of) the requested task.
   The Async trigger then triggers when the remote server replies
   The remote websocket server will be out of the scope of airflow and not 
implemented here.
   
   ### Use case/motivation
   
   A common use case is to run long lived tasks asynchronously when the 
duration of execution is unknown.
   Http requests are not the best for long lived connections so a http trigger 
may not be optimal.
   The currently provided timer trigger does not meet this requirement
   A websocket request would be better suited for this (I would even go further 
and propose a messaging system(e.g kafka) is the best option in such a case - I 
might open a different feature request if this current feature is approved)
   
   ### Related issues
   
   _No response_
   
   ### Are you willing to submit a PR?
   
   - [X] Yes I am willing to submit a PR!
   
   ### Code of Conduct
   
   - [X] I agree to follow this project's [Code of 
Conduct](https://github.com/apache/airflow/blob/main/CODE_OF_CONDUCT.md)
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]


Reply via email to