Hi, I am in the process of making airflow logging backed by Elasticsearch (more detail please check AIRFLOW-1325 <https://issues.apache.org/jira/browse/AIRFLOW-1325>). Here are several more logging improvements we are considering:
*1. Log streaming.* Auto-refresh the logs if tasks are running. *2. Separate logs by attempts.* [image: Screen Shot 2017-06-21 at 2.49.11 PM.png] Instead of logging everything into one file, logs can be separated by attempt number and displayed using tabs. Attempt number here is a monotonically increasing number that represents each task instance run (unlike try_number, clear task instance won't reset attempt number). *try_number:* n^th retry by the task instance. try_number should not be greater than retries. Clear task will set try_number to 0. *attempt:* number of times current task instance got executed. *3. Collapsable logs.* Collapse logs that are mainly for debugging airflow internal and aren't really related to users' tasks (for example, logs showed before "starting attempt 1 of 1") All suggestions are welcome. Thanks, Allison
