0x26res opened a new issue, #31148:
URL: https://github.com/apache/airflow/issues/31148

   ### Description
   
   The aws 
[BatchOperator](https://github.com/apache/airflow/blob/521dae534dd0b906e4dd9a7446c6bec3f9022ac3/airflow/providers/amazon/aws/operators/batch.py#L47)
 uses boto3 batch 
[submit_job](https://boto3.amazonaws.com/v1/documentation/api/latest/reference/services/batch/client/submit_job.html).
   
   At the moment the constructor of BatchOperator allows you to customise some 
aspect of the batch job (eg: job_definition, job_queue etc). But this doesn't 
cover all the options that can be passed to boto3 batch submit_job. 
   
   In particular I'd like to be able to pass the parameter 
`schedulingPriorityOverride`
   
   ### Use case/motivation
   
   I submit a lot of array jobs to aws batch using airflow. As there can only 
be a limited number of job running at the same time, aws schedule jobs on a mix 
of FIFO logic and using the `schedulingPriorityOverride`. 
   
   As I have jobs with higher priority than other, I'd like to be able to 
customise that argument for my high priority jobs. So they don't get blocked 
until the other lower priority jobs are done.
   
   ### Related issues
   
   _No response_
   
   ### Are you willing to submit a PR?
   
   - [X] Yes I am willing to submit a PR!
   
   ### Code of Conduct
   
   - [X] I agree to follow this project's [Code of 
Conduct](https://github.com/apache/airflow/blob/main/CODE_OF_CONDUCT.md)
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to