[
https://issues.apache.org/jira/browse/AIRFLOW-4397?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16830899#comment-16830899
]
ASF subversion and git services commented on AIRFLOW-4397:
----------------------------------------------------------
Commit 370987dfb7b54dce33c13f66535df0567f44fc6c in airflow's branch
refs/heads/v1-10-test from Jacob Ferriero
[ https://gitbox.apache.org/repos/asf?p=airflow.git;h=370987d ]
[AIRFLOW-4397] add integrations docs manually for gcs sensors (#5204)
(cherry picked from commit 7eb7abe18513008bf7dc00b61a9ae05062ea5bb2)
> Add GCSUploadSessionCompleteSensor
> ----------------------------------
>
> Key: AIRFLOW-4397
> URL: https://issues.apache.org/jira/browse/AIRFLOW-4397
> Project: Apache Airflow
> Issue Type: New Feature
> Components: contrib
> Reporter: Jacob Ferriero
> Assignee: Jacob Ferriero
> Priority: Minor
> Labels: beginner, newbie
> Fix For: 1.10.4, 2.0.0
>
>
> I'd like to contribute a Sensor for Google Cloud Storage that can poke a
> bucket until there has been sufficient time without a new file drop. Often
> times there are cases where a third party vendor drops data to a bucket but
> don't send a success flag when they are done. This sensor would allow you to
> poke every n minutes to check if more files have been added since the last
> poke, and if there had been `inactivity_period` minutes without a new file
> drop, return `True`. This could allow SLA misses if data did not arrive by an
> expected time, and have a configurable deadline past which the sensor would
> fail. Optionally the user could specify a minimum number of files for the
> sensor to succeed. This would be my first time contributing to an OSS
> project, so please let me know if this is not the appropriate place to start.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
