vincbeck commented on code in PR #30757:
URL: https://github.com/apache/airflow/pull/30757#discussion_r1172880610
##########
tests/system/providers/amazon/aws/example_emr_serverless.py:
##########
@@ -100,13 +101,14 @@
configuration_overrides=SPARK_CONFIGURATION_OVERRIDES,
)
# [END howto_operator_emr_serverless_start_job]
- start_job.waiter_check_interval_seconds = 10
+ start_job.wait_for_completion = False
# [START howto_sensor_emr_serverless_job]
wait_for_job = EmrServerlessJobSensor(
task_id="wait_for_job",
application_id=emr_serverless_app_id,
job_run_id=start_job.output,
+ target_states=EmrServerlessHook.JOB_INTERMEDIATE_STATES,
Review Comment:
Maybe moving this one out of the doc tag? I dont think this is necessary to
have it in docs. It can confuse users. I would also add a comment to explain
why we are doing so
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
