mans2singh commented on issue #4887: [AIRFLOW-4055] Add AWS SQS Sensor URL: https://github.com/apache/airflow/pull/4887#issuecomment-471737248 @XD-DENG - My use case is that we have files dropped on S3 and need to process them as soon as possible. Since I do not know the time when the file will be available or it's complete path I am driving the DAG with an SQS event. The sensor retrieves the message containing file path etc, and passes it to the next processor to consume the file. This allows me to use airflow sensors nice features like timeout, manage task dependencies, etc. The sensor is similar to [pub sub sensor](https://github.com/apache/airflow/blob/master/airflow/contrib/sensors/pubsub_sensor.py). Please let me know if there is a better way to implementing this workflow. Thanks
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services
