[
https://issues.apache.org/jira/browse/AIRFLOW-4397?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16829906#comment-16829906
]
ASF GitHub Bot commented on AIRFLOW-4397:
-----------------------------------------
jaketf commented on pull request #5204: [AIRFLOW-4397] add integrations docs
manually for gcs sensors
URL: https://github.com/apache/airflow/pull/5204
This PR adds documentation for GCS sensors and replaces #5201.
@potiuk for review.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
> Add GCSUploadSessionCompleteSensor
> ----------------------------------
>
> Key: AIRFLOW-4397
> URL: https://issues.apache.org/jira/browse/AIRFLOW-4397
> Project: Apache Airflow
> Issue Type: New Feature
> Components: contrib
> Reporter: Jacob Ferriero
> Assignee: Jacob Ferriero
> Priority: Minor
> Labels: beginner, newbie
> Fix For: 1.10.4, 2.0.0
>
>
> I'd like to contribute a Sensor for Google Cloud Storage that can poke a
> bucket until there has been sufficient time without a new file drop. Often
> times there are cases where a third party vendor drops data to a bucket but
> don't send a success flag when they are done. This sensor would allow you to
> poke every n minutes to check if more files have been added since the last
> poke, and if there had been `inactivity_period` minutes without a new file
> drop, return `True`. This could allow SLA misses if data did not arrive by an
> expected time, and have a configurable deadline past which the sensor would
> fail. Optionally the user could specify a minimum number of files for the
> sensor to succeed. This would be my first time contributing to an OSS
> project, so please let me know if this is not the appropriate place to start.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
