Ritika-Singhal opened a new pull request #19787: URL: https://github.com/apache/airflow/pull/19787
<!-- Existing issue: closes: #19207 related: #19207 This commit is to fix a bug in the AWS Glue Job operator. In the case when we specify the `WorkerType` and `NumberOfWorkers` as the parameters in the `create_job_kwargs`, the glue job creation would fail. This is because AWS Glue API does not allow to use "AllocatedCapacity" or "MaxCapacity" parameters when the 'WorkerType' and 'NumberOfWorkers' are being assigned. This is the issue which I have addressed and fixed in this commit. I have removed the "AllocatedCapacity" or "MaxCapacity" parameters from the `glue_client.create_job` function call if the `WorkerType` and `NumberOfWorkers` are given. --> --- **^ Add meaningful description above** Read the **[Pull Request Guidelines](https://github.com/apache/airflow/blob/main/CONTRIBUTING.rst#pull-request-guidelines)** for more information. In case of fundamental code change, Airflow Improvement Proposal ([AIP](https://cwiki.apache.org/confluence/display/AIRFLOW/Airflow+Improvements+Proposals)) is needed. In case of a new dependency, check compliance with the [ASF 3rd Party License Policy](https://www.apache.org/legal/resolved.html#category-x). In case of backwards incompatible changes please leave a note in [UPDATING.md](https://github.com/apache/airflow/blob/main/UPDATING.md). -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
