This is an automated email from the ASF dual-hosted git repository.
onikolas pushed a commit to branch main
in repository https://gitbox.apache.org/repos/asf/airflow.git
The following commit(s) were added to refs/heads/main by this push:
new 779226706c Remove duplicate and unsupported keys unchanged task
(#32267)
779226706c is described below
commit 779226706c1d64e0fe1e19c5f077ead9c9b4914a
Author: Niko Oliveira <[email protected]>
AuthorDate: Thu Jun 29 13:28:30 2023 -0700
Remove duplicate and unsupported keys unchanged task (#32267)
A new task was added to the S3 system test for the new deferrable
keys unchanged operator. However it used a duplicate task key and
also deferrable tasks are not yet supported for the AWS system tests
---
docs/apache-airflow-providers-amazon/operators/s3/s3.rst | 6 ------
tests/system/providers/amazon/aws/example_s3.py | 12 +-----------
2 files changed, 1 insertion(+), 17 deletions(-)
diff --git a/docs/apache-airflow-providers-amazon/operators/s3/s3.rst
b/docs/apache-airflow-providers-amazon/operators/s3/s3.rst
index 72e90c50ca..4d83416761 100644
--- a/docs/apache-airflow-providers-amazon/operators/s3/s3.rst
+++ b/docs/apache-airflow-providers-amazon/operators/s3/s3.rst
@@ -289,12 +289,6 @@ You can also run this sensor in deferrable mode by setting
the parameter ``defer
This will lead to efficient utilization of Airflow workers as polling for job
status happens on
the triggerer asynchronously. Note that this will need triggerer to be
available on your Airflow deployment.
-.. exampleinclude:: /../../tests/system/providers/amazon/aws/example_s3.py
- :language: python
- :dedent: 4
- :start-after: [START howto_sensor_s3_keys_unchanged_deferrable]
- :end-before: [END howto_sensor_s3_keys_unchanged_deferrable]
-
Reference
---------
diff --git a/tests/system/providers/amazon/aws/example_s3.py
b/tests/system/providers/amazon/aws/example_s3.py
index 484b47fba0..87806a0bf0 100644
--- a/tests/system/providers/amazon/aws/example_s3.py
+++ b/tests/system/providers/amazon/aws/example_s3.py
@@ -240,23 +240,13 @@ with DAG(
)
# [START howto_sensor_s3_keys_unchanged]
- sensor_keys_unchanged = S3KeysUnchangedSensor(
- task_id="sensor_keys_unchanged",
- bucket_name=bucket_name_2,
- prefix=PREFIX,
- inactivity_period=10,
- )
- # [END howto_sensor_s3_keys_unchanged]
-
- # [START howto_sensor_s3_keys_unchanged_deferrable]
sensor_keys_unchanged = S3KeysUnchangedSensor(
task_id="sensor_keys_unchanged",
bucket_name=bucket_name_2,
prefix=PREFIX,
inactivity_period=10, # inactivity_period in seconds
- deferrable=True,
)
- # [END howto_sensor_s3_keys_unchanged_deferrable]
+ # [END howto_sensor_s3_keys_unchanged]
# [START howto_operator_s3_delete_objects]
delete_objects = S3DeleteObjectsOperator(
