eff917 commented on issue #51456:
URL: https://github.com/apache/airflow/issues/51456#issuecomment-3150583405
I have run into the same problem.
Tested:
airlfow helm chart, with kubernetesExecutor.
Airflow versions tried:
3.03, 2.11.0, 2.10.5, 2.9.3
Elasticsearch versions tried: 9.0.0, 8.19.0
Webserver correctly picks up ES connection, and queries return http 200 with
0 results obviously.
Task pods don't even initiate a connection to ES, have confirmed this with
tcpdump on the ES pod's network interface.
Envvars are picked up, because if I change the write_stdout to `True`, task
pods write the json lines to stdout in addition to the standard text output.
relevant part of helm chart:
```
config:
...
elasticsearch:
write_stdout: 'False'
write_to_es: 'True'
# target_index: 'airflow_tasks'
json_format: 'True'
# log_id_template: "{dag_id}_{task_id}_{execution_date}_{try_number}"
elasticsearch_configs:
max_retries: 3
timeout: 30
retry_timeout: 'True'
verify_certs: 'False'
```
If I can do any more testing, or need any additional info, let me know.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
