rawwar opened a new issue, #44694:
URL: https://github.com/apache/airflow/issues/44694
### Apache Airflow Provider(s)
amazon
### Versions of Apache Airflow Providers
apache-airflow-providers-amazon==9.1.0
### Apache Airflow version
2.10.3
### Operating System
ubuntu-22.04
### Deployment
Astronomer
### Deployment details
_No response_
### What happened
GlueJobOperator was stuck in running for a long time, while the actual Glue
job on AWS took a minute to complete. This is only happening when Verbose is
set to Truehappens
### What you think should happen instead
It should not get stuck for a long time when Verbose is set to True
### How to reproduce
I used the following DAG Code:
```
from airflow import DAG
from airflow.operators.python import PythonOperator
from airflow.providers.amazon.aws.operators.glue import GlueJobOperator
from datetime import timedelta
from datetime import datetime
def _start():
print("Hi")
def _end():
print("Job end")
with DAG("dag_glue_script_python", catchup=False) as dag:
start = PythonOperator(task_id="start", python_callable=_start)
start_glue_job = GlueJobOperator(
job_name='sleep2',
task_id='run',
aws_conn_id='aws_cre',
create_job_kwargs={"NumberOfWorkers": 1, "WorkerType": "G.1X"},
stop_job_run_on_kill=True,
verbose=True,
wait_for_completion=True,
deferrable=True,
job_poll_interval=15
)
end = PythonOperator(task_id="end", python_callable=_end)
start >> start_glue_job >> end
```
### Anything else
_No response_
### Are you willing to submit PR?
- [ ] Yes I am willing to submit a PR!
### Code of Conduct
- [X] I agree to follow this project's [Code of
Conduct](https://github.com/apache/airflow/blob/main/CODE_OF_CONDUCT.md)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
