[
https://issues.apache.org/jira/browse/AIRFLOW-1913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jason Prodonovich updated AIRFLOW-1913:
---------------------------------------
Description:
There have been requests for Operators that pull messages from Google Cloud
Pub/Sub and then act upon the receipt of those messages. In order to facilitate
that, additional PubSub Operators must be added to handle creation and deletion
of both topics and subscriptions. This will allow for Workflows and end-to-end
tests to perform all of the necessary setup and cleanup when wishing to
subscribe and process messages from a topic.
A subsequent issue will be created for the Pull and Acknowledge Operators.
was:
There have been requests for Operators that pull messages from Google Cloud
Pub/Sub and then act upon the receipt of those messages. In order to facilitate
that, additional capabilities must be added to the PubSubHook class that allow
for creating/deleting Subscriptions and adding the ability to delete a Topic
from a project as well.
These capabilities allow for Workflows and end-to-end tests to perform all of
the necessary setup and cleanup when creating, publishing, receiving, and
removing messages to and from Cloud PubSub topics.
> Add Delete Operator for GCP Pub/Sub Topics and Create/Delete Operator for
> Subscriptions
> ---------------------------------------------------------------------------------------
>
> Key: AIRFLOW-1913
> URL: https://issues.apache.org/jira/browse/AIRFLOW-1913
> Project: Apache Airflow
> Issue Type: Improvement
> Components: contrib, gcp, hooks
> Affects Versions: Airflow 1.8
> Reporter: Jason Prodonovich
> Assignee: Jason Prodonovich
> Original Estimate: 72h
> Remaining Estimate: 72h
>
> There have been requests for Operators that pull messages from Google Cloud
> Pub/Sub and then act upon the receipt of those messages. In order to
> facilitate that, additional PubSub Operators must be added to handle creation
> and deletion of both topics and subscriptions. This will allow for Workflows
> and end-to-end tests to perform all of the necessary setup and cleanup when
> wishing to subscribe and process messages from a topic.
> A subsequent issue will be created for the Pull and Acknowledge Operators.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
