[
https://issues.apache.org/jira/browse/AIRFLOW-6978?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17063241#comment-17063241
]
ASF subversion and git services commented on AIRFLOW-6978:
----------------------------------------------------------
Commit 759ce2a80c95832fe4773c9f4fde23e1b03cbc6f in airflow's branch
refs/heads/master from Tomek Urbaszek
[ https://gitbox.apache.org/repos/asf?p=airflow.git;h=759ce2a ]
[AIRFLOW-6978] Add PubSubPullOperator (#7766)
* Fix typo.
* Type checking: pass empty dict instead of None to operators in test scenarios.
* Reformat some whitespace.
* Fix PubSubHook.pull return value type annotation.
* PubSubHook.acknowledge: Implement acknowledging by passing list of
ReceivedMessage objects.
* Refactor PubSubPullSensor.
* Implement PubSubPullOperator.
* Remove unused constant from PubSub tests.
* Fix Sensor contract: some do have a return value.
* Reformat whitespace in PubSub tests.
* PubSub: Add tests for PubSubPullOperator.
* Fix PubSubPullSensor tests after refactoring.
* Sort imports.
* Fix pylint complaining about callback interface.
* Update airflow/providers/google/cloud/operators/pubsub.py
Co-Authored-By: Kamil Breguła <[email protected]>
* Update airflow/providers/google/cloud/hooks/pubsub.py
Co-Authored-By: Kamil Breguła <[email protected]>
* Update airflow/providers/google/cloud/hooks/pubsub.py
Co-Authored-By: Kamil Breguła <[email protected]>
* Update airflow/providers/google/cloud/operators/pubsub.py
Co-Authored-By: Kamil Breguła <[email protected]>
* Reorder PubSub messages_callback argument.
* Update docstring.
* Reformat mutually exclusive argument handling logic in PubSubHook.
* PubSub: Deprecate return_immediately argument.
* Implement example DAG and system test for PubSubPullOperator.
* Fix docstring formatting.
* PubSubPullOperator: Fix docs.
* Apply suggestions from code review
Co-Authored-By: Tomek Urbaszek <[email protected]>
Co-authored-by: Aleksander Nitecki <[email protected]>
Co-authored-by: ANiteckiP <[email protected]>
Co-authored-by: Kamil Breguła <[email protected]>
> Add PubSubPullOperator
> ----------------------
>
> Key: AIRFLOW-6978
> URL: https://issues.apache.org/jira/browse/AIRFLOW-6978
> Project: Apache Airflow
> Issue Type: Improvement
> Components: gcp, operators
> Affects Versions: 2.0.0
> Reporter: Aleksander Nitecki
> Priority: Major
> Labels: operators, pull-request-available
> Fix For: 2.0.0
>
>
> Add PubSubPullOperator - a non-blocking equivalent to Add PubSubPullSensor.
> These two share most of functionality but ultimately serve different purpose
> - while existing PubSubPullSensor will block the pipeline until it receives a
> message, new PubSubPullOperator can be used to check for new messages
> opportunistically.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
