potiuk edited a comment on issue #12969:
URL: https://github.com/apache/airflow/issues/12969#issuecomment-744317850
setting `AIRFLOW__CORE__EXECUTE_TASKS_NEW_PYTHON_INTERPRETER=True` partially
helps - we seem to hit the "ORM disposed" problem
```
[2020-12-14 09:44:09,987] {s3_task_handler.py:208} ERROR - Could not write
logs to
s3://test-amazon-logging/airflowlogs/example_bash_operator/run_afte│172.23.0.1
- - [14/Dec/2020:09:44:05 +0000] "POST /last_dagruns HTTP/1.1" 200 202
"http://localhost:28080/home"; "Mozilla/5.0 (X11; Linux x86_64) App
r_loop/2020-12-14T09:44:05.331058+00:00/1.log
│leWebKit/537.36 (KHTML, like Gecko) Chrome/87.0.4280.88 Safari/537.36"
Traceback (most recent call last):
│172.23.0.1 - - [14/Dec/2020:09:44:05 +0000] "POST /blocked HTTP/1.1" 200 117
"http://localhost:28080/home"; "Mozilla/5.0 (X11; Linux x86_64) AppleWeb
File
"/usr/local/lib/python3.8/site-packages/airflow/providers/amazon/aws/log/s3_task_handler.py",
line 201, in s3_write │Kit/537.36 (KHTML, like
Gecko) Chrome/87.0.4280.88 Safari/537.36"
self.hook.load_string(
│172.23.0.1 - - [14/Dec/2020:09:44:05 +0000] "POST /task_stats HTTP/1.1" 200
24117 "http://localhost:28080/home"; "Mozilla/5.0 (X11; Linux x86_64) App
File
"/usr/local/lib/python3.8/site-packages/airflow/providers/amazon/aws/hooks/s3.py",
line 57, in wrapper │leWebKit/537.36
(KHTML, like Gecko) Chrome/87.0.4280.88 Safari/537.36"
connection = self.get_connection(self.aws_conn_id)
│[2020-12-14 09:44:07 +0000] [1098] [INFO] Handling signal: ttin
File "/usr/local/lib/python3.8/site-packages/airflow/hooks/base.py", line
63, in get_connection
│[2020-12-14 09:44:07 +0000] [934441] [INFO] Booting worker with pid: 934441
conn = Connection.get_connection_from_secrets(conn_id)
│[2020-12-14 09:44:10 +0000] [1098] [INFO] Handling signal: ttou
File
"/usr/local/lib/python3.8/site-packages/airflow/models/connection.py", line
351, in get_connection_from_secrets │[2020-12-14
09:44:10 +0000] [908605] [INFO] Worker exiting (pid: 908605)
conn = secrets_backend.get_connection(conn_id=conn_id)
│[2020-12-14 09:44:38 +0000] [1098] [INFO] Handling signal: ttin
File "/usr/local/lib/python3.8/site-packages/airflow/utils/session.py",
line 64, in wrapper
│[2020-12-14 09:44:38 +0000] [942004] [INFO] Booting worker with pid: 942004
with create_session() as session:
│[2020-12-14 09:44:41 +0000] [1098] [INFO] Handling signal: ttou
File "/usr/local/lib/python3.8/contextlib.py", line 113, in __enter__
│[2020-12-14 09:44:41 +0000] [916301] [INFO] Worker exiting (pid: 916301)
return next(self.gen)
│[2020-12-14 09:45:08 +0000] [1098] [INFO] Handling signal: ttin
File "/usr/local/lib/python3.8/site-packages/airflow/utils/session.py",
line 29, in create_session
│[2020-12-14 09:45:08 +0000] [949507] [INFO] Booting worker with pid: 949507
session = settings.Session()
│[2020-12-14 09:45:11 +0000] [1098] [INFO] Handling signal: ttou
TypeError: 'NoneType' object is not callable
```
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
