aelzeiny opened a new pull request #7011: Fargate Executor
URL: https://github.com/apache/airflow/pull/7011
 
 
   An AWS Fargate Executor that runs every task on a new Fargate Instance. The 
instance launches an Airflow Docker Container (i.e: Puckel's Airflow Docker), 
executes the task generated by the scheduler, then reaches the container 
reaches a timely demise.
   If the exit code of the 
   
   - container is anything other than 0 the task fails.
   - If the boto3 API calls to Fargate fails 3 times _consecutively_, then the 
task fails.
   - If the executor is unable to call out to the Fargate task (due to internet 
connectivity issues or incorrect IAM roles) then the task fails.
   
   Otherwise the task succeeds.

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
[email protected]


With regards,
Apache Git Services

Reply via email to