potiuk commented on issue #22861: URL: https://github.com/apache/airflow/issues/22861#issuecomment-1098075635
I think it's incompatibility between the way Elasticsearch uses GRPC and Celery. You can try to avoid forking altogether by: * Changing celery pool strategy https://airflow.apache.org/docs/apache-airflow/stable/configurations-ref.html#pool * Changing Airflow task execution strategy to not use forking: https://airflow.apache.org/docs/apache-airflow/stable/configurations-ref.html#execute-tasks-new-python-interpreter Experimenting with those two might help. I will convert it to a discussion - please let us know what is the result of this experimentation. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
