SameerMesiah97 commented on code in PR #75915:
URL: https://github.com/apache/airflow/pull/75915#discussion_r4569126020
##########
providers/amazon/src/airflow/providers/amazon/aws/triggers/athena.py:
##########
@@ -66,3 +66,55 @@ def hook(self) -> AwsGenericHook:
verify=self.verify,
config=self.botocore_config,
)
+
+
+class AthenaSparkTrigger(AwsBaseWaiterTrigger):
+ """
+ Wait asynchronously for an Athena Spark calculation to reach a terminal
state.
+
+ :param calculation_execution_id: Calculation execution ID to monitor.
+ :param waiter_delay: Seconds between status checks. Defaults to 30.
+ :param waiter_max_attempts: Maximum number of polling attempts. Defaults
to 120.
+ :param aws_conn_id: Airflow connection used for AWS credentials. Defaults
to ``aws_default``.
Review Comment:
Fixed.
##########
providers/amazon/src/airflow/providers/amazon/aws/operators/athena_spark.py:
##########
@@ -49,11 +51,14 @@ class AthenaSparkOperator(AwsBaseOperator[AthenaHook]):
:param waiter_delay: Seconds to wait between status checks. Defaults to 30.
:param waiter_max_attempts: Maximum number of polling attempts before
timing out. Defaults to 120.
To limit total task time, use execution_timeout on the task as well.
+ :param deferrable: Whether to wait asynchronously using the triggerer.
+ Defaults to the ``operators.default_deferrable`` configuration value
(False).
:param log_query: Whether to log submission details. Defaults to True.
:param aws_conn_id: The Airflow connection used for AWS credentials.
Defaults to ``aws_default``.
:param region_name: AWS region. If not set, default boto3 behavior is
used. Defaults to None.
:param verify: Whether to verify SSL certificates. Defaults to None.
:param botocore_config: Optional botocore configuration dict. Defaults to
None.
+
Review Comment:
Removed.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
