ShelRoman opened a new pull request, #28464:
URL: https://github.com/apache/airflow/pull/28464

   A small tweak related to https://github.com/apache/airflow/pull/27286
   ```
    WaiterConfig={
        "Delay": 5,
        "MaxAttempts": 100,
   }
   ```
   The hardcoded config isn't usable with jobs that are running longer than 
~500 seconds.
   Moved those values into default arguments of the `add_job_flow_steps()` 
function which won't change default behaviour but will add some flexibility for 
use cases with longer emr steps.
   
   Also considered option to pass whole config dict instead of `waiter_delay` 
and `waiter_max_attempts`, but these changes are smaller.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to