[ 
https://issues.apache.org/jira/browse/AIRFLOW-4397?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16830897#comment-16830897
 ] 

ASF subversion and git services commented on AIRFLOW-4397:
----------------------------------------------------------

Commit 7eb7abe18513008bf7dc00b61a9ae05062ea5bb2 in airflow's branch 
refs/heads/master from Jacob Ferriero
[ https://gitbox.apache.org/repos/asf?p=airflow.git;h=7eb7abe ]

[AIRFLOW-4397] add integrations docs manually for gcs sensors (#5204)



> Add GCSUploadSessionCompleteSensor
> ----------------------------------
>
>                 Key: AIRFLOW-4397
>                 URL: https://issues.apache.org/jira/browse/AIRFLOW-4397
>             Project: Apache Airflow
>          Issue Type: New Feature
>          Components: contrib
>            Reporter: Jacob Ferriero
>            Assignee: Jacob Ferriero
>            Priority: Minor
>              Labels: beginner, newbie
>             Fix For: 1.10.4, 2.0.0
>
>
> I'd like to contribute a Sensor for Google Cloud Storage that can poke a 
> bucket until there has been sufficient time without a new file drop. Often 
> times there are cases where a third party vendor drops data to a bucket but 
> don't send a success flag when they are done. This sensor would allow you to 
> poke every n minutes to check if more files have been added since the last 
> poke, and if there had been `inactivity_period` minutes without a new file 
> drop, return `True`. This could allow SLA misses if data did not arrive by an 
> expected time, and have a configurable deadline past which the sensor would 
> fail. Optionally the user could specify a minimum number of files for the 
> sensor to succeed. This would be my first time contributing to an OSS 
> project, so please let me know if this is not the appropriate place to start.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Reply via email to