niroam opened a new issue, #59226: URL: https://github.com/apache/airflow/issues/59226
https://github.com/apache/airflow/blob/3c2163729d353b2eb723907ed8e286d94e601c81/providers/amazon/src/airflow/providers/amazon/aws/hooks/glue.py#L463 Hi Team, When creating and running a new Glue Job via this operator e.g GlueJobOperator_1765238188320 = GlueJobOperator( task_id='job-task', job_name='mygluejob, script_location='test.py', s3_bucket='mys3bucket', create_job_kwargs={ 'GlueVersion': GLUE_JOB_CONFIG['GlueVersion'], 'NumberOfWorkers': GLUE_JOB_CONFIG['NumberOfWorkers'], 'WorkerType': GLUE_JOB_CONFIG['WorkerType'], 'Timeout': GLUE_JOB_CONFIG['Timeout'], 'MaxRetries': GLUE_JOB_CONFIG['MaxRetries'], 'ExecutionClass': GLUE_JOB_CONFIG['ExecutionClass'], 'Command': GLUE_JOB_CONFIG['Command'], 'DefaultArguments': GLUE_JOB_CONFIG['DefaultArguments'], 'Connections': GLUE_JOB_CONFIG['Connections'], 'Tags': GLUE_JOB_CONFIG['Tags'] }, iam_role_arn=project.iam_role, update_config=True ) the boto3 create_job supports Tags, however update_job does not should we be removing these from the args in our update job method in the airflow operator ? do we need a seperate check on tags changing here ? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
