[jira] [Commented] (AIRFLOW-1667) Remote log handlers don't upload logs on task finish

[ https://issues.apache.org/jira/browse/AIRFLOW-1667?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16195759#comment-16195759 ] Allison Wang commented on AIRFLOW-1667: --- Great I didn't realize the closed flag is removed in

[jira] [Comment Edited] (AIRFLOW-1667) Remote log handlers don't upload logs

[ https://issues.apache.org/jira/browse/AIRFLOW-1667?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16195581#comment-16195581 ] Allison Wang edited comment on AIRFLOW-1667 at 10/7/17 5:25 AM: I agree

[jira] [Comment Edited] (AIRFLOW-1667) Remote log handlers don't upload logs

[ https://issues.apache.org/jira/browse/AIRFLOW-1667?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16195581#comment-16195581 ] Allison Wang edited comment on AIRFLOW-1667 at 10/7/17 5:24 AM: I agree

[jira] [Commented] (AIRFLOW-1667) Remote log handlers don't upload logs

[ https://issues.apache.org/jira/browse/AIRFLOW-1667?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16195581#comment-16195581 ] Allison Wang commented on AIRFLOW-1667: --- I agree that we shouldn't rely on the logging module's

[jira] [Resolved] (AIRFLOW-1385) Make Airflow task logging configurable

[ https://issues.apache.org/jira/browse/AIRFLOW-1385?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allison Wang resolved AIRFLOW-1385. --- Resolution: Fixed > Make Airflow task logging configurable >

[jira] [Updated] (AIRFLOW-1325) Airflow streaming log backed by ElasticSearch

[ https://issues.apache.org/jira/browse/AIRFLOW-1325?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allison Wang updated AIRFLOW-1325: -- Summary: Airflow streaming log backed by ElasticSearch (was: Enable ElasticSearch for

[jira] [Updated] (AIRFLOW-1325) Enable ElasticSearch for Airflow Logs

[ https://issues.apache.org/jira/browse/AIRFLOW-1325?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allison Wang updated AIRFLOW-1325: -- Summary: Enable ElasticSearch for Airflow Logs (was: Airflow Log Backed By ElasticSearch) >

[jira] [Updated] (AIRFLOW-1325) Airflow Log Backed By ElasticSearch

[ https://issues.apache.org/jira/browse/AIRFLOW-1325?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allison Wang updated AIRFLOW-1325: -- Description: Add Elasticsearch log handler and reader for querying logs in ES was:Add

[jira] [Updated] (AIRFLOW-1325) Airflow Log Backed By ElasticSearch

[ https://issues.apache.org/jira/browse/AIRFLOW-1325?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allison Wang updated AIRFLOW-1325: -- Summary: Airflow Log Backed By ElasticSearch (was: Airflow Streaming Log Backed By

[jira] [Updated] (AIRFLOW-1325) Airflow Streaming Log Backed By ElasticSearch

[ https://issues.apache.org/jira/browse/AIRFLOW-1325?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allison Wang updated AIRFLOW-1325: -- Description: Add Elasticsearch logging backend. (was: Currently, Airflow uses S3/GCS as the

[jira] [Closed] (AIRFLOW-1443) Update Airflow configuration documentation

[ https://issues.apache.org/jira/browse/AIRFLOW-1443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allison Wang closed AIRFLOW-1443. - Resolution: Fixed > Update Airflow configuration documentation >

[jira] [Closed] (AIRFLOW-1332) Split logs based on try_number

[ https://issues.apache.org/jira/browse/AIRFLOW-1332?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allison Wang closed AIRFLOW-1332. - Resolution: Fixed > Split logs based on try_number > -- > >

[jira] [Closed] (AIRFLOW-1485) Get configuration throws exceptions when key does not exist

[ https://issues.apache.org/jira/browse/AIRFLOW-1485?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allison Wang closed AIRFLOW-1485. - Resolution: Fixed > Get configuration throws exceptions when key does not exist >

[jira] [Created] (AIRFLOW-1485) Get configuration throws exceptions when key does not exist

Allison Wang created AIRFLOW-1485: - Summary: Get configuration throws exceptions when key does not exist Key: AIRFLOW-1485 URL: https://issues.apache.org/jira/browse/AIRFLOW-1485 Project: Apache

[jira] [Comment Edited] (AIRFLOW-1452) "airflow initdb" stuck forever on upgrade

[ https://issues.apache.org/jira/browse/AIRFLOW-1452?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16111697#comment-16111697 ] Allison Wang edited comment on AIRFLOW-1452 at 8/2/17 8:57 PM: --- Then there

[jira] [Commented] (AIRFLOW-1452) "airflow initdb" stuck forever on upgrade

[ https://issues.apache.org/jira/browse/AIRFLOW-1452?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16106261#comment-16106261 ] Allison Wang commented on AIRFLOW-1452: --- Hi Pavel. This migration indeed takes a long time,

[jira] [Updated] (AIRFLOW-1454) Make Airflow logging configurable

[ https://issues.apache.org/jira/browse/AIRFLOW-1454?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allison Wang updated AIRFLOW-1454: -- Issue Type: Improvement (was: Task) > Make Airflow logging configurable >

[jira] [Updated] (AIRFLOW-1454) Make Airflow logging configurable

[ https://issues.apache.org/jira/browse/AIRFLOW-1454?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allison Wang updated AIRFLOW-1454: -- Issue Type: Task (was: Improvement) > Make Airflow logging configurable >

[jira] [Assigned] (AIRFLOW-1454) Make Airflow logging configurable

[ https://issues.apache.org/jira/browse/AIRFLOW-1454?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allison Wang reassigned AIRFLOW-1454: - Assignee: (was: Allison Wang) > Make Airflow logging configurable >

[jira] [Created] (AIRFLOW-1457) Unify Airflow logging setup

Allison Wang created AIRFLOW-1457: - Summary: Unify Airflow logging setup Key: AIRFLOW-1457 URL: https://issues.apache.org/jira/browse/AIRFLOW-1457 Project: Apache Airflow Issue Type:

[jira] [Updated] (AIRFLOW-1455) Move logging related configs out of airflow.cfg

[ https://issues.apache.org/jira/browse/AIRFLOW-1455?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allison Wang updated AIRFLOW-1455: -- Description: All logging related configurations including `LOG_BASE_FOLDER`,

[jira] [Updated] (AIRFLOW-1455) Move logging related configs out of airflow.cfg

[ https://issues.apache.org/jira/browse/AIRFLOW-1455?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allison Wang updated AIRFLOW-1455: -- Description: All logging related configurations including {{LOG_BASE_FOLDER}},

[jira] [Updated] (AIRFLOW-1455) Move logging related configs out of airflow.cfg

[ https://issues.apache.org/jira/browse/AIRFLOW-1455?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allison Wang updated AIRFLOW-1455: -- Description: All logging related configurations including {{LOG_BASE_FOLDER}},

[jira] [Updated] (AIRFLOW-1455) Move logging related configs out of airflow.cfg

[ https://issues.apache.org/jira/browse/AIRFLOW-1455?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allison Wang updated AIRFLOW-1455: -- Description: All logging related configurations including ``LOG_BASE_FOLDER``,

[jira] [Updated] (AIRFLOW-1455) Move logging related configs out of airflow.cfg

[ https://issues.apache.org/jira/browse/AIRFLOW-1455?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allison Wang updated AIRFLOW-1455: -- Summary: Move logging related configs out of airflow.cfg (was: Move logging related config

[jira] [Created] (AIRFLOW-1455) Move logging related config out of airflow.cfg

Allison Wang created AIRFLOW-1455: - Summary: Move logging related config out of airflow.cfg Key: AIRFLOW-1455 URL: https://issues.apache.org/jira/browse/AIRFLOW-1455 Project: Apache Airflow

[jira] [Updated] (AIRFLOW-1454) Make Airflow logging configurable

[ https://issues.apache.org/jira/browse/AIRFLOW-1454?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allison Wang updated AIRFLOW-1454: -- Description: Airflow logging should be configurable. Users can provide custom log handlers,

[jira] [Updated] (AIRFLOW-1454) Make Airflow logging configurable

[ https://issues.apache.org/jira/browse/AIRFLOW-1454?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allison Wang updated AIRFLOW-1454: -- Description: Airflow logging should be configurable. Users can provide custom log handlers,

[jira] [Updated] (AIRFLOW-1385) Make Airflow task logging configurable

[ https://issues.apache.org/jira/browse/AIRFLOW-1385?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allison Wang updated AIRFLOW-1385: -- Description: Make Airflow task logging supports custom loggers and handlers. > Make Airflow

[jira] [Updated] (AIRFLOW-1385) Make Airflow task logging configurable

[ https://issues.apache.org/jira/browse/AIRFLOW-1385?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allison Wang updated AIRFLOW-1385: -- Summary: Make Airflow task logging configurable (was: Refactor Airflow task logging) > Make

[jira] [Updated] (AIRFLOW-1385) Refactor Airflow task logging

[ https://issues.apache.org/jira/browse/AIRFLOW-1385?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allison Wang updated AIRFLOW-1385: -- Description: (was: Unify Airflow logging and adds custom logger and handler conguration.)

[jira] [Updated] (AIRFLOW-1385) Refactor Airflow task logging

[ https://issues.apache.org/jira/browse/AIRFLOW-1385?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allison Wang updated AIRFLOW-1385: -- Issue Type: Sub-task (was: Improvement) Parent: AIRFLOW-1454 > Refactor Airflow task

[jira] [Created] (AIRFLOW-1454) Make Airflow logging configurable

Allison Wang created AIRFLOW-1454: - Summary: Make Airflow logging configurable Key: AIRFLOW-1454 URL: https://issues.apache.org/jira/browse/AIRFLOW-1454 Project: Apache Airflow Issue Type:

[jira] [Work started] (AIRFLOW-1454) Make Airflow logging configurable

[ https://issues.apache.org/jira/browse/AIRFLOW-1454?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on AIRFLOW-1454 started by Allison Wang. - > Make Airflow logging configurable > - > >

[jira] [Updated] (AIRFLOW-1385) Refactor Airflow task logging

[ https://issues.apache.org/jira/browse/AIRFLOW-1385?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allison Wang updated AIRFLOW-1385: -- Summary: Refactor Airflow task logging (was: Make Airflow logging configurable) > Refactor

[jira] [Updated] (AIRFLOW-1385) Make Airflow logging configurable

[ https://issues.apache.org/jira/browse/AIRFLOW-1385?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allison Wang updated AIRFLOW-1385: -- Summary: Make Airflow logging configurable (was: Create abstraction for Airflow task

[jira] [Updated] (AIRFLOW-1325) Airflow Streaming Log Backed By ElasticSearch

[ https://issues.apache.org/jira/browse/AIRFLOW-1325?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allison Wang updated AIRFLOW-1325: -- Summary: Airflow Streaming Log Backed By ElasticSearch (was: Make Airflow Logging Backed By

[jira] [Updated] (AIRFLOW-1325) Make Airflow Logging Backed By Elasticsearch

[ https://issues.apache.org/jira/browse/AIRFLOW-1325?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allison Wang updated AIRFLOW-1325: -- Description: Currently, Airflow uses S3/GCS as the log storage backend. Workers, when

[jira] [Created] (AIRFLOW-1443) Update Airflow configuration documentation

Allison Wang created AIRFLOW-1443: - Summary: Update Airflow configuration documentation Key: AIRFLOW-1443 URL: https://issues.apache.org/jira/browse/AIRFLOW-1443 Project: Apache Airflow

[jira] [Updated] (AIRFLOW-1385) Create abstraction for Airflow task logging

[ https://issues.apache.org/jira/browse/AIRFLOW-1385?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allison Wang updated AIRFLOW-1385: -- Description: Unify Airflow logging and adds custom logger and handler conguration. > Create

[jira] [Closed] (AIRFLOW-1366) Add max_tries to task instance

[ https://issues.apache.org/jira/browse/AIRFLOW-1366?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allison Wang closed AIRFLOW-1366. - > Add max_tries to task instance > -- > > Key:

[jira] [Resolved] (AIRFLOW-1366) Add max_tries to task instance

[ https://issues.apache.org/jira/browse/AIRFLOW-1366?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allison Wang resolved AIRFLOW-1366. --- Resolution: Done > Add max_tries to task instance > -- > >

[jira] [Created] (AIRFLOW-1385) Create abstraction for Airflow worker log handler

Allison Wang created AIRFLOW-1385: - Summary: Create abstraction for Airflow worker log handler Key: AIRFLOW-1385 URL: https://issues.apache.org/jira/browse/AIRFLOW-1385 Project: Apache Airflow

[jira] [Created] (AIRFLOW-1366) Add max_tries to task instance

Allison Wang created AIRFLOW-1366: - Summary: Add max_tries to task instance Key: AIRFLOW-1366 URL: https://issues.apache.org/jira/browse/AIRFLOW-1366 Project: Apache Airflow Issue Type:

[jira] [Updated] (AIRFLOW-1332) Split logs based on try_number

[ https://issues.apache.org/jira/browse/AIRFLOW-1332?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allison Wang updated AIRFLOW-1332: -- Description: Split airflow logs based on current try_number. It also add `.log` suffix to

[jira] [Updated] (AIRFLOW-1332) Split logs based on try_number

[ https://issues.apache.org/jira/browse/AIRFLOW-1332?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allison Wang updated AIRFLOW-1332: -- Description: Split airflow logs based on current try_number. It also add {{.log}} suffix to

[jira] [Commented] (AIRFLOW-1325) Make Airflow Logging Backed By Elasticsearch

[ https://issues.apache.org/jira/browse/AIRFLOW-1325?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16061491#comment-16061491 ] Allison Wang commented on AIRFLOW-1325: --- Yes airflow will only use ES if the user configures the

[jira] [Updated] (AIRFLOW-1325) Make Airflow Logging Backed By Elasticsearch

[ https://issues.apache.org/jira/browse/AIRFLOW-1325?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allison Wang updated AIRFLOW-1325: -- Description: Currently, Airflow uses S3/GCS as the log storage backend. Workers, when

[jira] [Updated] (AIRFLOW-1325) Make Airflow Logging Backed By Elasticsearch

[ https://issues.apache.org/jira/browse/AIRFLOW-1325?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allison Wang updated AIRFLOW-1325: -- Description: Currently, Airflow uses S3/GCS as the log storage backend. Workers, when

[jira] [Updated] (AIRFLOW-1325) Make Airflow Logging Backed By Elasticsearch

[ https://issues.apache.org/jira/browse/AIRFLOW-1325?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allison Wang updated AIRFLOW-1325: -- Description: Currently, Airflow uses S3/GCS as the log storage backend. Workers, when

[jira] [Created] (AIRFLOW-1332) Add attempt column to task instance

Allison Wang created AIRFLOW-1332: - Summary: Add attempt column to task instance Key: AIRFLOW-1332 URL: https://issues.apache.org/jira/browse/AIRFLOW-1332 Project: Apache Airflow Issue Type:

[jira] [Work started] (AIRFLOW-1332) Add attempt column to task instance

[ https://issues.apache.org/jira/browse/AIRFLOW-1332?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on AIRFLOW-1332 started by Allison Wang. - > Add attempt column to task instance > ---

[jira] [Updated] (AIRFLOW-1325) Make Airflow Logging Backed By Elasticsearch

[ https://issues.apache.org/jira/browse/AIRFLOW-1325?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allison Wang updated AIRFLOW-1325: -- Description: Move logging to Elasticsearch and also make it backward compatible. This feature

[jira] [Work started] (AIRFLOW-1325) Make Airflow Logging Backed By Elasticsearch

[ https://issues.apache.org/jira/browse/AIRFLOW-1325?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on AIRFLOW-1325 started by Allison Wang. - > Make Airflow Logging Backed By Elasticsearch >

[jira] [Created] (AIRFLOW-1325) Make Airflow Logging Backed By Elasticsearch

Allison Wang created AIRFLOW-1325: - Summary: Make Airflow Logging Backed By Elasticsearch Key: AIRFLOW-1325 URL: https://issues.apache.org/jira/browse/AIRFLOW-1325 Project: Apache Airflow