andriisoldatenko commented on a change in pull request #5048: [AIRFLOW-3370]
Add stdout output options to Elasticsearch task log handler
URL: https://github.com/apache/airflow/pull/5048#discussion_r288034244
##########
File path: airflow/config_templates/default_airflow.cfg
##########
@@ -561,13 +561,22 @@ api_rev = v3
hide_sensitive_variable_fields = True
[elasticsearch]
+# Elasticsearch host
elasticsearch_host =
+# Format of the log_id, which is used to query for a given tasks logs
elasticsearch_log_id_template =
{{dag_id}}-{{task_id}}-{{execution_date}}-{{try_number}}
+# Used to mark the end of a log stream for a task
elasticsearch_end_of_log_mark = end_of_log
# Qualified URL for an elasticsearch frontend (like Kibana) with a template
argument for log_id
# Code will construct log_id using the log_id template from the argument above.
# NOTE: The code will prefix the https:// automatically, don't include that
here.
elasticsearch_frontend =
+# Write the task logs to the stdout of the worker, rather than the default
files
+elasticsearch_write_stdout = False
Review comment:
@ashb what about `elasticsearch_end_of_log_mark` and another options?
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
With regards,
Apache Git Services
