peter-cheon opened a new issue, #50349: URL: https://github.com/apache/airflow/issues/50349
### Apache Airflow version 3.0.0 ### If "Other Airflow 2 version" selected, which one? _No response_ ### What happened? Hello, I tried to set up log integration using the guide at https://airflow.apache.org/docs/apache-airflow-providers-elasticsearch/stable/logging/index.html#writing-logs-to-elasticsearch, but the integration is not working. ### What you think should happen instead? _No response_ ### How to reproduce In the Helm chart, I enabled the host as shown below: ``` elasticsearch: # Enable elasticsearch task logging enabled: true # A secret containing the connection connection: scheme: http host: es-example.local port: 9200 ``` I also added the following configuration: ``` elasticsearch: host: 'es-example.local:9200' write_stdout: 'True' write_to_es: 'True' json_format: 'True' log_id_template: "{dag_id}_{task_id}_{execution_date}_{try_number}" elasticsearch_configs: max_retries: 3 timeout: 30 retry_timeout: 'True' ``` When I check inside the container using airflow.cfg, I can see the settings as below: ``` [logging] colored_console_log = False remote_logging = True [elasticsearch] host = es-example.local:80 json_format = True log_id_template = {dag_id}_{task_id}_{execution_date}_{try_number} write_stdout = True write_to_es = True [elasticsearch_configs] max_retries = 3 retry_timeout = True timeout = 30 ``` Running airflow info also shows: ``` > airflow info Apache Airflow version | 3.0.1rc1 executor | CeleryExecutor task_logging_handler | airflow.providers.elasticsearch.log.es_task_handler.ElasticsearchTaskHandler sql_alchemy_conn | postgresql://..../ dags_folder | /opt/airflow/dags/repo/sandbox plugins_folder | /opt/airflow/plugins base_log_folder | /opt/airflow/logs remote_base_log_folder | ``` Everything appears to be configured correctly, but nothing is being written to the task logs. I’m wondering if there is a problem with Elasticsearch integration in Airflow 3.0. Thank you. ### Operating System kubernetes ### Versions of Apache Airflow Providers _No response_ ### Deployment Other ### Deployment details I deployed the Helm chart from https://github.com/apache/airflow/tree/main/chart ### Anything else? _No response_ ### Are you willing to submit PR? - [ ] Yes I am willing to submit a PR! ### Code of Conduct - [x] I agree to follow this project's [Code of Conduct](https://github.com/apache/airflow/blob/main/CODE_OF_CONDUCT.md) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@airflow.apache.org.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
