[jira] [Comment Edited] (AIRFLOW-1894) Rebase and migrate existing Airflow GCP operators to google-python-cloud

2018-10-03 Thread Feng Lu (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-1894?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16637794#comment-16637794 ] Feng Lu edited comment on AIRFLOW-1894 at 10/4/18 4:16 AM: --- [~yiga2] it's on

[jira] [Comment Edited] (AIRFLOW-1894) Rebase and migrate existing Airflow GCP operators to google-python-cloud

2018-10-03 Thread Feng Lu (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-1894?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16637794#comment-16637794 ] Feng Lu edited comment on AIRFLOW-1894 at 10/4/18 4:16 AM: --- [~yiga2] it's on

[jira] [Comment Edited] (AIRFLOW-1894) Rebase and migrate existing Airflow GCP operators to google-python-cloud

2018-10-03 Thread Feng Lu (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-1894?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16637794#comment-16637794 ] Feng Lu edited comment on AIRFLOW-1894 at 10/4/18 4:15 AM: --- [~yiga2] it's on

[jira] [Comment Edited] (AIRFLOW-1894) Rebase and migrate existing Airflow GCP operators to google-python-cloud

2018-10-03 Thread Feng Lu (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-1894?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16637794#comment-16637794 ] Feng Lu edited comment on AIRFLOW-1894 at 10/4/18 4:14 AM: --- [~yiga2] it's on

[jira] [Comment Edited] (AIRFLOW-1894) Rebase and migrate existing Airflow GCP operators to google-python-cloud

2018-10-03 Thread Feng Lu (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-1894?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16637794#comment-16637794 ] Feng Lu edited comment on AIRFLOW-1894 at 10/4/18 4:14 AM: --- [~yiga2] it's on

[jira] [Comment Edited] (AIRFLOW-1894) Rebase and migrate existing Airflow GCP operators to google-python-cloud

2018-10-03 Thread Feng Lu (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-1894?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16637794#comment-16637794 ] Feng Lu edited comment on AIRFLOW-1894 at 10/4/18 4:14 AM: --- [~yiga2] it's on

[jira] [Commented] (AIRFLOW-1894) Rebase and migrate existing Airflow GCP operators to google-python-cloud

2018-10-03 Thread Feng Lu (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-1894?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16637794#comment-16637794 ] Feng Lu commented on AIRFLOW-1894: -- [~yiga2] it's on our to-do list, the current focus is to move all

[jira] [Comment Edited] (AIRFLOW-1894) Rebase and migrate existing Airflow GCP operators to google-python-cloud

2018-10-03 Thread Feng Lu (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-1894?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16637794#comment-16637794 ] Feng Lu edited comment on AIRFLOW-1894 at 10/4/18 4:13 AM: --- [~yiga2] it's on

[jira] [Commented] (AIRFLOW-1894) Rebase and migrate existing Airflow GCP operators to google-python-cloud

2018-10-03 Thread Yannick Einsweiler (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-1894?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16637753#comment-16637753 ] Yannick Einsweiler commented on AIRFLOW-1894: - Has the migration fallen off the radar ?

[GitHub] feng-tao commented on issue #3997: [AIRFLOW-3153] send dag last_run to statsd

2018-10-03 Thread GitBox
feng-tao commented on issue #3997: [AIRFLOW-3153] send dag last_run to statsd URL: https://github.com/apache/incubator-airflow/pull/3997#issuecomment-426870875 PTAL @kaxil This is an automated message from the Apache Git

[GitHub] codecov-io edited a comment on issue #3991: [WIP] Backfill missing sensor tests.

2018-10-03 Thread GitBox
codecov-io edited a comment on issue #3991: [WIP] Backfill missing sensor tests. URL: https://github.com/apache/incubator-airflow/pull/3991#issuecomment-426509904 # [Codecov](https://codecov.io/gh/apache/incubator-airflow/pull/3991?src=pr=h1) Report > Merging

[jira] [Resolved] (AIRFLOW-2934) Pools not respected for internal subdag tasks

2018-10-03 Thread Victor Vianna (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2934?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Victor Vianna resolved AIRFLOW-2934. Resolution: Fixed Thanks! > Pools not respected for internal subdag tasks >

[jira] [Created] (AIRFLOW-3155) Add ability to filter by a last modified time in GoogleCloudStorageToGoogleCloudStorageOperator

2018-10-03 Thread Brandon Kvarda (JIRA)
Brandon Kvarda created AIRFLOW-3155: --- Summary: Add ability to filter by a last modified time in GoogleCloudStorageToGoogleCloudStorageOperator Key: AIRFLOW-3155 URL:

[jira] [Created] (AIRFLOW-3154) Failed attempt to send SLA miss email blocks scheduling for DAG with miss

2018-10-03 Thread Wilson Lian (JIRA)
Wilson Lian created AIRFLOW-3154: Summary: Failed attempt to send SLA miss email blocks scheduling for DAG with miss Key: AIRFLOW-3154 URL: https://issues.apache.org/jira/browse/AIRFLOW-3154 Project:

[GitHub] feng-tao commented on issue #3937: [AIRFLOW-3103][AIRFLOW-3147] Update flask-appbuilder

2018-10-03 Thread GitBox
feng-tao commented on issue #3937: [AIRFLOW-3103][AIRFLOW-3147] Update flask-appbuilder URL: https://github.com/apache/incubator-airflow/pull/3937#issuecomment-426836985 @ashb , I think this pr is ready. And it needs to be checked in to unblock the CI.

[GitHub] feng-tao opened a new pull request #3997: [AIRFLOW-3153] send dag last_run to statsd

2018-10-03 Thread GitBox
feng-tao opened a new pull request #3997: [AIRFLOW-3153] send dag last_run to statsd URL: https://github.com/apache/incubator-airflow/pull/3997 Make sure you have checked _all_ steps below. ### Jira - [x] My PR addresses the following [Airflow

[jira] [Commented] (AIRFLOW-3153) send dag last_run to statsd

2018-10-03 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3153?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16637594#comment-16637594 ] ASF GitHub Bot commented on AIRFLOW-3153: - feng-tao opened a new pull request #3997:

[jira] [Closed] (AIRFLOW-3004) Add configuration option to disable schedules

2018-10-03 Thread Jacob Greenfield (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jacob Greenfield closed AIRFLOW-3004. - Resolution: Implemented > Add configuration option to disable schedules >

[jira] [Updated] (AIRFLOW-3152) Kubernetes Pod Operator should support init containers

2018-10-03 Thread Sriraam AS (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sriraam AS updated AIRFLOW-3152: Affects Version/s: 1.10.1 > Kubernetes Pod Operator should support init containers >

[jira] [Updated] (AIRFLOW-3152) Kubernetes Pod Operator should support init containers

2018-10-03 Thread Sriraam AS (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sriraam AS updated AIRFLOW-3152: Priority: Major (was: Minor) > Kubernetes Pod Operator should support init containers >

[jira] [Created] (AIRFLOW-3152) Kubernetes Pod Operator should support init containers

2018-10-03 Thread Sriraam AS (JIRA)
Sriraam AS created AIRFLOW-3152: --- Summary: Kubernetes Pod Operator should support init containers Key: AIRFLOW-3152 URL: https://issues.apache.org/jira/browse/AIRFLOW-3152 Project: Apache Airflow

[jira] [Assigned] (AIRFLOW-3004) Add configuration option to disable schedules

2018-10-03 Thread Tao Feng (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Feng reassigned AIRFLOW-3004: - Assignee: Tao Feng (was: Jacob Greenfield) > Add configuration option to disable schedules >

[jira] [Commented] (AIRFLOW-3004) Add configuration option to disable schedules

2018-10-03 Thread Tao Feng (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16637562#comment-16637562 ] Tao Feng commented on AIRFLOW-3004: --- PR merged. Please close the ticket. > Add configuration option

[jira] [Assigned] (AIRFLOW-3004) Add configuration option to disable schedules

2018-10-03 Thread Tao Feng (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Feng reassigned AIRFLOW-3004: - Assignee: Jacob Greenfield (was: Tao Feng) > Add configuration option to disable schedules >

[jira] [Commented] (AIRFLOW-3004) Add configuration option to disable schedules

2018-10-03 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16637558#comment-16637558 ] ASF GitHub Bot commented on AIRFLOW-3004: - feng-tao closed pull request #3899: [AIRFLOW-3004]

[GitHub] feng-tao closed pull request #3899: [AIRFLOW-3004] Add config disabling scheduler cron

2018-10-03 Thread GitBox
feng-tao closed pull request #3899: [AIRFLOW-3004] Add config disabling scheduler cron URL: https://github.com/apache/incubator-airflow/pull/3899 This is a PR merged from a forked repository. As GitHub hides the original diff on merge, it is displayed below for the sake of provenance:

[GitHub] feng-tao edited a comment on issue #3899: [AIRFLOW-3004] Add config disabling scheduler cron

2018-10-03 Thread GitBox
feng-tao edited a comment on issue #3899: [AIRFLOW-3004] Add config disabling scheduler cron URL: https://github.com/apache/incubator-airflow/pull/3899#issuecomment-426822017 LGTM. The use case makes sense. This is an

[GitHub] feng-tao commented on issue #3899: [AIRFLOW-3004] Add config disabling scheduler cron

2018-10-03 Thread GitBox
feng-tao commented on issue #3899: [AIRFLOW-3004] Add config disabling scheduler cron URL: https://github.com/apache/incubator-airflow/pull/3899#issuecomment-426822017 LGTM This is an automated message from the Apache Git

[GitHub] feng-tao edited a comment on issue #3993: [AIRFLOW-1354] Fix pool_link() return value

2018-10-03 Thread GitBox
feng-tao edited a comment on issue #3993: [AIRFLOW-1354] Fix pool_link() return value URL: https://github.com/apache/incubator-airflow/pull/3993#issuecomment-426821189 flake8 fails. And is it an issue for www_rbac as well?

[GitHub] feng-tao commented on issue #3993: [AIRFLOW-1354] Fix pool_link() return value

2018-10-03 Thread GitBox
feng-tao commented on issue #3993: [AIRFLOW-1354] Fix pool_link() return value URL: https://github.com/apache/incubator-airflow/pull/3993#issuecomment-426821189 flake8 fails. And is it another issue for www_rbac as well?

[GitHub] feng-tao commented on issue #3996: [AIRFLOW-3151] Pin FlaskAppBuilder 1.11.1 in setup.py

2018-10-03 Thread GitBox
feng-tao commented on issue #3996: [AIRFLOW-3151] Pin FlaskAppBuilder 1.11.1 in setup.py URL: https://github.com/apache/incubator-airflow/pull/3996#issuecomment-426820837 https://github.com/apache/incubator-airflow/pull/3937 should fix the issue. Besides we need the latest FAB(1.12) as

[jira] [Commented] (AIRFLOW-3151) FlaskAppBuilder 1.12.0 is installed by default and breaks www_rbac UI.

2018-10-03 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3151?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16637526#comment-16637526 ] ASF GitHub Bot commented on AIRFLOW-3151: - oliviersm199 opened a new pull request #3996:

[GitHub] oliviersm199 opened a new pull request #3996: [AIRFLOW-3151] Pin FlaskAppBuilder 1.11.1 in setup.py

2018-10-03 Thread GitBox
oliviersm199 opened a new pull request #3996: [AIRFLOW-3151] Pin FlaskAppBuilder 1.11.1 in setup.py URL: https://github.com/apache/incubator-airflow/pull/3996 ### Jira My PR addresses the following [AIRFLOW-3151](https://issues.apache.org/jira/browse/AIRFLOW-3151) ###

[jira] [Closed] (AIRFLOW-3142) Fix deprecated calls to BigQueryBaseCursor.run_query

2018-10-03 Thread Jason Shao (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3142?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Shao closed AIRFLOW-3142. --- Resolution: Won't Fix > Fix deprecated calls to BigQueryBaseCursor.run_query >

[GitHub] jason-udacity commented on issue #3987: [AIRFLOW-3142] Fix deprecated calls to BigQueryBaseCursor.run_query

2018-10-03 Thread GitBox
jason-udacity commented on issue #3987: [AIRFLOW-3142] Fix deprecated calls to BigQueryBaseCursor.run_query URL: https://github.com/apache/incubator-airflow/pull/3987#issuecomment-426790228 @kaxil makes sense. I wasn't sure if there would be a 1.11/1.10.1 release first. thanks for

[GitHub] codecov-io edited a comment on issue #3937: [AIRFLOW-3103][AIRFLOW-3147] Update flask-appbuilder

2018-10-03 Thread GitBox
codecov-io edited a comment on issue #3937: [AIRFLOW-3103][AIRFLOW-3147] Update flask-appbuilder URL: https://github.com/apache/incubator-airflow/pull/3937#issuecomment-426722645 # [Codecov](https://codecov.io/gh/apache/incubator-airflow/pull/3937?src=pr=h1) Report > Merging

[GitHub] codecov-io edited a comment on issue #3937: [AIRFLOW-3103][AIRFLOW-3147] Update flask-appbuilder

2018-10-03 Thread GitBox
codecov-io edited a comment on issue #3937: [AIRFLOW-3103][AIRFLOW-3147] Update flask-appbuilder URL: https://github.com/apache/incubator-airflow/pull/3937#issuecomment-426722645 # [Codecov](https://codecov.io/gh/apache/incubator-airflow/pull/3937?src=pr=h1) Report > Merging

[jira] [Commented] (AIRFLOW-3142) Fix deprecated calls to BigQueryBaseCursor.run_query

2018-10-03 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3142?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16637453#comment-16637453 ] ASF GitHub Bot commented on AIRFLOW-3142: - kaxil closed pull request #3987: [AIRFLOW-3142] Fix

[GitHub] kaxil closed pull request #3987: [AIRFLOW-3142] Fix deprecated calls to BigQueryBaseCursor.run_query

2018-10-03 Thread GitBox
kaxil closed pull request #3987: [AIRFLOW-3142] Fix deprecated calls to BigQueryBaseCursor.run_query URL: https://github.com/apache/incubator-airflow/pull/3987 This is a PR merged from a forked repository. As GitHub hides the original diff on merge, it is displayed below for the sake of

[GitHub] kaxil commented on issue #3987: [AIRFLOW-3142] Fix deprecated calls to BigQueryBaseCursor.run_query

2018-10-03 Thread GitBox
kaxil commented on issue #3987: [AIRFLOW-3142] Fix deprecated calls to BigQueryBaseCursor.run_query URL: https://github.com/apache/incubator-airflow/pull/3987#issuecomment-426777445 Thanks for this PR but we plan to deprecate it in Airflow 2.0 and it will be a part of major changes going

[jira] [Updated] (AIRFLOW-3150) Make execution_date a template field in TriggerDagRunOperator

2018-10-03 Thread Kyle Hamlin (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kyle Hamlin updated AIRFLOW-3150: - Labels: easy-fix (was: ) > Make execution_date a template field in TriggerDagRunOperator >

[jira] [Created] (AIRFLOW-3150) Make execution_date a template field in TriggerDagRunOperator

2018-10-03 Thread Kyle Hamlin (JIRA)
Kyle Hamlin created AIRFLOW-3150: Summary: Make execution_date a template field in TriggerDagRunOperator Key: AIRFLOW-3150 URL: https://issues.apache.org/jira/browse/AIRFLOW-3150 Project: Apache

[GitHub] codecov-io commented on issue #3937: [AIRFLOW-3103][AIRFLOW-3147] Update flask-appbuilder

2018-10-03 Thread GitBox
codecov-io commented on issue #3937: [AIRFLOW-3103][AIRFLOW-3147] Update flask-appbuilder URL: https://github.com/apache/incubator-airflow/pull/3937#issuecomment-426722645 # [Codecov](https://codecov.io/gh/apache/incubator-airflow/pull/3937?src=pr=h1) Report > Merging

[jira] [Created] (AIRFLOW-3149) GCP dataproc cluster creation should have the option to delete an ERROR cluster

2018-10-03 Thread Aaron Dossett (JIRA)
Aaron Dossett created AIRFLOW-3149: -- Summary: GCP dataproc cluster creation should have the option to delete an ERROR cluster Key: AIRFLOW-3149 URL: https://issues.apache.org/jira/browse/AIRFLOW-3149

[GitHub] feng-tao commented on issue #3937: [AIRFLOW-3103] Update flask-login.

2018-10-03 Thread GitBox
feng-tao commented on issue #3937: [AIRFLOW-3103] Update flask-login. URL: https://github.com/apache/incubator-airflow/pull/3937#issuecomment-426709131 Cool. Great to see this pr :) This is an automated message from the

[GitHub] ashb commented on issue #3937: [AIRFLOW-3103] Update flask-login.

2018-10-03 Thread GitBox
ashb commented on issue #3937: [AIRFLOW-3103] Update flask-login. URL: https://github.com/apache/incubator-airflow/pull/3937#issuecomment-426708423 You need this too: ``` diff --git a/tests/www_rbac/test_security.py b/tests/www_rbac/test_security.py index 67ea5b30..6e0b5726

[GitHub] ashb commented on a change in pull request #3937: [AIRFLOW-3103] Update flask-login.

2018-10-03 Thread GitBox
ashb commented on a change in pull request #3937: [AIRFLOW-3103] Update flask-login. URL: https://github.com/apache/incubator-airflow/pull/3937#discussion_r222380402 ## File path: tests/www/test_utils.py ## @@ -143,7 +143,7 @@ def some_func():

[GitHub] ashb commented on a change in pull request #3937: [AIRFLOW-3103] Update flask-login.

2018-10-03 Thread GitBox
ashb commented on a change in pull request #3937: [AIRFLOW-3103] Update flask-login. URL: https://github.com/apache/incubator-airflow/pull/3937#discussion_r222380107 ## File path: setup.py ## @@ -298,10 +298,10 @@ def do_setup(): 'croniter>=0.3.17, <0.4',

[GitHub] ashb edited a comment on issue #3937: [AIRFLOW-3103] Update flask-login.

2018-10-03 Thread GitBox
ashb edited a comment on issue #3937: [AIRFLOW-3103] Update flask-login. URL: https://github.com/apache/incubator-airflow/pull/3937#issuecomment-426670833 @jmcarp Looks like something else needs an update: ``` AttributeError: does not have the attribute '_get_user' ```

[GitHub] ashb edited a comment on issue #3937: [AIRFLOW-3103] Update flask-login.

2018-10-03 Thread GitBox
ashb edited a comment on issue #3937: [AIRFLOW-3103] Update flask-login. URL: https://github.com/apache/incubator-airflow/pull/3937#issuecomment-426670833 @jmcarp Looks like something else needs an update: ``` AttributeError: does not have the attribute '_get_user' ```

[jira] [Commented] (AIRFLOW-3148) Argument "parameters" in RedshiftToS3Transfer is not necessary

2018-10-03 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3148?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16637063#comment-16637063 ] ASF GitHub Bot commented on AIRFLOW-3148: - XD-DENG opened a new pull request #3995:

[GitHub] XD-DENG opened a new pull request #3995: [AIRFLOW-3148] Remove unnecessary arg "parameters" in RedshiftToS3Transfer

2018-10-03 Thread GitBox
XD-DENG opened a new pull request #3995: [AIRFLOW-3148] Remove unnecessary arg "parameters" in RedshiftToS3Transfer URL: https://github.com/apache/incubator-airflow/pull/3995 Make sure you have checked _all_ steps below. ### Jira - [x] My PR addresses the following [Airflow

[jira] [Created] (AIRFLOW-3148) Argument "parameters" in RedshiftToS3Transfer is not necessary

2018-10-03 Thread Xiaodong DENG (JIRA)
Xiaodong DENG created AIRFLOW-3148: -- Summary: Argument "parameters" in RedshiftToS3Transfer is not necessary Key: AIRFLOW-3148 URL: https://issues.apache.org/jira/browse/AIRFLOW-3148 Project: Apache

[GitHub] ashb commented on issue #3937: [AIRFLOW-3103] Update flask-login.

2018-10-03 Thread GitBox
ashb commented on issue #3937: [AIRFLOW-3103] Update flask-login. URL: https://github.com/apache/incubator-airflow/pull/3937#issuecomment-426670833 @jmcarp Looks like something else needs an update: ``` AttributeError: does not have the attribute '_get_user' ```

[GitHub] sethwoodworth commented on issue #3918: [AIRFLOW-3088] Include slack-compatible emoji image.

2018-10-03 Thread GitBox
sethwoodworth commented on issue #3918: [AIRFLOW-3088] Include slack-compatible emoji image. URL: https://github.com/apache/incubator-airflow/pull/3918#issuecomment-426650027 @r39132 Renamed and rebased This is an automated

[GitHub] ashb commented on issue #3937: [AIRFLOW-3103] Update flask-login.

2018-10-03 Thread GitBox
ashb commented on issue #3937: [AIRFLOW-3103] Update flask-login. URL: https://github.com/apache/incubator-airflow/pull/3937#issuecomment-426649250 FAB has been released, am re-running the tests to see if they pass. This is

[jira] [Created] (AIRFLOW-3147) Update Flask-AppBuilder version

2018-10-03 Thread Ash Berlin-Taylor (JIRA)
Ash Berlin-Taylor created AIRFLOW-3147: -- Summary: Update Flask-AppBuilder version Key: AIRFLOW-3147 URL: https://issues.apache.org/jira/browse/AIRFLOW-3147 Project: Apache Airflow Issue

[GitHub] ashb closed pull request #3990: [AIRFLOW-2951] Update dag_run table end_date when state change

2018-10-03 Thread GitBox
ashb closed pull request #3990: [AIRFLOW-2951] Update dag_run table end_date when state change URL: https://github.com/apache/incubator-airflow/pull/3990 This is a PR merged from a forked repository. As GitHub hides the original diff on merge, it is displayed below for the sake of

[jira] [Commented] (AIRFLOW-2951) dag_run end_date Null after a dag is finished

2018-10-03 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16636958#comment-16636958 ] ASF GitHub Bot commented on AIRFLOW-2951: - ashb closed pull request #3990: [AIRFLOW-2951]

[GitHub] ron819 commented on issue #2799: airflow uses OAuth Provider keycloak

2018-10-03 Thread GitBox
ron819 commented on issue #2799: airflow uses OAuth Provider keycloak URL: https://github.com/apache/incubator-airflow/pull/2799#issuecomment-426630882 @fisher-monkey @Fokko is there any progress with this? This is an

[GitHub] ron819 commented on issue #2233: [AIRFLOW-1098] Fix issue in setting parent_dag when loading dags

2018-10-03 Thread GitBox
ron819 commented on issue #2233: [AIRFLOW-1098] Fix issue in setting parent_dag when loading dags URL: https://github.com/apache/incubator-airflow/pull/2233#issuecomment-426622739 @xiaomj is this still relevant? This is an

[jira] [Commented] (AIRFLOW-3071) Unable to clear Val of Variable from the UI

2018-10-03 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16636898#comment-16636898 ] ASF GitHub Bot commented on AIRFLOW-3071: - ron819 closed pull request #3948: [AIRFLOW-3071]

[GitHub] ron819 closed pull request #3948: [AIRFLOW-3071] clear Val of Variable from the UI

2018-10-03 Thread GitBox
ron819 closed pull request #3948: [AIRFLOW-3071] clear Val of Variable from the UI URL: https://github.com/apache/incubator-airflow/pull/3948 This is a PR merged from a forked repository. As GitHub hides the original diff on merge, it is displayed below for the sake of provenance: As

[GitHub] phani8996 commented on a change in pull request #3989: [AIRFLOW-1945] Autoscale celery workers for airflow added

2018-10-03 Thread GitBox
phani8996 commented on a change in pull request #3989: [AIRFLOW-1945] Autoscale celery workers for airflow added URL: https://github.com/apache/incubator-airflow/pull/3989#discussion_r79356 ## File path: airflow/config_templates/default_airflow.cfg ## @@ -349,6

[GitHub] simonvanderveldt edited a comment on issue #3504: [AIRFLOW-2310]: Add AWS Glue Job Compatibility to Airflow

2018-10-03 Thread GitBox
simonvanderveldt edited a comment on issue #3504: [AIRFLOW-2310]: Add AWS Glue Job Compatibility to Airflow URL: https://github.com/apache/incubator-airflow/pull/3504#issuecomment-426541089 @OElesin Have you been able to make any progress on this? There's one duplicate file in there

[GitHub] simonvanderveldt edited a comment on issue #3504: [AIRFLOW-2310]: Add AWS Glue Job Compatibility to Airflow

2018-10-03 Thread GitBox
simonvanderveldt edited a comment on issue #3504: [AIRFLOW-2310]: Add AWS Glue Job Compatibility to Airflow URL: https://github.com/apache/incubator-airflow/pull/3504#issuecomment-426541089 @OElesin Have you been able to make any progress on this? There's one duplicate file in there

[GitHub] simonvanderveldt edited a comment on issue #3504: [AIRFLOW-2310]: Add AWS Glue Job Compatibility to Airflow

2018-10-03 Thread GitBox
simonvanderveldt edited a comment on issue #3504: [AIRFLOW-2310]: Add AWS Glue Job Compatibility to Airflow URL: https://github.com/apache/incubator-airflow/pull/3504#issuecomment-426541089 @OElesin Have you been able to make any progress on this? There's one duplicate file in there

[GitHub] simonvanderveldt edited a comment on issue #3504: [AIRFLOW-2310]: Add AWS Glue Job Compatibility to Airflow

2018-10-03 Thread GitBox
simonvanderveldt edited a comment on issue #3504: [AIRFLOW-2310]: Add AWS Glue Job Compatibility to Airflow URL: https://github.com/apache/incubator-airflow/pull/3504#issuecomment-426541089 @OElesin Have you been able to make any progress on this? There's one duplicate file in there

[jira] [Created] (AIRFLOW-3146) TimeDeltaSensor - consider also end time stamp

2018-10-03 Thread jack (JIRA)
jack created AIRFLOW-3146: - Summary: TimeDeltaSensor - consider also end time stamp Key: AIRFLOW-3146 URL: https://issues.apache.org/jira/browse/AIRFLOW-3146 Project: Apache Airflow Issue Type:

[GitHub] codecov-io commented on issue #3993: [AIRFLOW-1354] Fix pool_link() return value

2018-10-03 Thread GitBox
codecov-io commented on issue #3993: [AIRFLOW-1354] Fix pool_link() return value URL: https://github.com/apache/incubator-airflow/pull/3993#issuecomment-426569292 # [Codecov](https://codecov.io/gh/apache/incubator-airflow/pull/3993?src=pr=h1) Report > Merging

[GitHub] codecov-io commented on issue #3987: [AIRFLOW-3142] Fix deprecated calls to BigQueryBaseCursor.run_query

2018-10-03 Thread GitBox
codecov-io commented on issue #3987: [AIRFLOW-3142] Fix deprecated calls to BigQueryBaseCursor.run_query URL: https://github.com/apache/incubator-airflow/pull/3987#issuecomment-426568474 # [Codecov](https://codecov.io/gh/apache/incubator-airflow/pull/3987?src=pr=h1) Report > Merging

[GitHub] KevinYang21 commented on issue #3990: [AIRFLOW-2951] Update dag_run table end_date when state change

2018-10-03 Thread GitBox
KevinYang21 commented on issue #3990: [AIRFLOW-2951] Update dag_run table end_date when state change URL: https://github.com/apache/incubator-airflow/pull/3990#issuecomment-426568248 :+1: LGTM This is an automated message

[jira] [Updated] (AIRFLOW-2800) Remove airflow/ low-hanging linting errors

2018-10-03 Thread Kaxil Naik (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2800?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kaxil Naik updated AIRFLOW-2800: Fix Version/s: (was: 2.0.0) 1.10.1 > Remove airflow/ low-hanging linting

[jira] [Updated] (AIRFLOW-1104) Concurrency check in scheduler should count queued tasks as well as running

2018-10-03 Thread Kaxil Naik (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-1104?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kaxil Naik updated AIRFLOW-1104: Fix Version/s: (was: 2.0.0) 1.10.1 > Concurrency check in scheduler

[jira] [Commented] (AIRFLOW-3144) Validate kerberos keytab on startup

2018-10-03 Thread Ash Berlin-Taylor (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16636630#comment-16636630 ] Ash Berlin-Taylor commented on AIRFLOW-3144: Sounds useful - is there an function in the

[jira] [Updated] (AIRFLOW-2674) BashOperator eats stdout and stderr logs

2018-10-03 Thread Ash Berlin-Taylor (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ash Berlin-Taylor updated AIRFLOW-2674: --- Fix Version/s: 1.10.1 Issue Type: Bug (was: Improvement) > BashOperator

[GitHub] ashb commented on issue #3990: [AIRFLOW-2951] Update dag_run table end_date when state change

2018-10-03 Thread GitBox
ashb commented on issue #3990: [AIRFLOW-2951] Update dag_run table end_date when state change URL: https://github.com/apache/incubator-airflow/pull/3990#issuecomment-426560565 Thanks @YingboWang This is an automated

[GitHub] ashb commented on a change in pull request #3994: [AIRFLOW-3136] Add retry_number to TaskInstance Key property to avoid race condition

2018-10-03 Thread GitBox
ashb commented on a change in pull request #3994: [AIRFLOW-3136] Add retry_number to TaskInstance Key property to avoid race condition URL: https://github.com/apache/incubator-airflow/pull/3994#discussion_r31277 ## File path: airflow/models.py ## @@ -1230,7 +1230,7 @@

[GitHub] ashb commented on a change in pull request #3989: [AIRFLOW-1945] Autoscale celery workers for airflow added

2018-10-03 Thread GitBox
ashb commented on a change in pull request #3989: [AIRFLOW-1945] Autoscale celery workers for airflow added URL: https://github.com/apache/incubator-airflow/pull/3989#discussion_r29910 ## File path: airflow/config_templates/default_airflow.cfg ## @@ -349,6 +349,14 @@

[GitHub] ashb commented on a change in pull request #3989: [AIRFLOW-1945] Autoscale celery workers for airflow added

2018-10-03 Thread GitBox
ashb commented on a change in pull request #3989: [AIRFLOW-1945] Autoscale celery workers for airflow added URL: https://github.com/apache/incubator-airflow/pull/3989#discussion_r29674 ## File path: airflow/config_templates/default_airflow.cfg ## @@ -349,6 +349,14 @@

[jira] [Commented] (AIRFLOW-2844) Airflow Logs BrokenPipeException

2018-10-03 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2844?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16636603#comment-16636603 ] jack commented on AIRFLOW-2844: --- if print("something") causes issues and Airflow recommended method is to

[jira] [Commented] (AIRFLOW-2674) BashOperator eats stdout and stderr logs

2018-10-03 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2674?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16636592#comment-16636592 ] jack commented on AIRFLOW-2674: --- I think it should be tagged as BUG not as improvement. > BashOperator

[jira] [Updated] (AIRFLOW-1354) www/views.py pool_link produces wrong link

2018-10-03 Thread Erik Cederstrand (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-1354?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Cederstrand updated AIRFLOW-1354: -- Affects Version/s: (was: 1.8.0) 1.10.0 > www/views.py

[jira] [Updated] (AIRFLOW-1354) www/views.py pool_link produces wrong link

2018-10-03 Thread Erik Cederstrand (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-1354?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Cederstrand updated AIRFLOW-1354: -- Description: The pool_link() function in www/views.py which produces the link on the

[jira] [Work started] (AIRFLOW-3134) Add New Operator - MySQLToS3TransformOperator

2018-10-03 Thread Stefano Francavilla (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on AIRFLOW-3134 started by Stefano Francavilla. > Add New Operator - MySQLToS3TransformOperator >

[jira] [Closed] (AIRFLOW-949) kill_process_tree does not kill the root process

2018-10-03 Thread Erik Cederstrand (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-949?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Cederstrand closed AIRFLOW-949. Resolution: Duplicate > kill_process_tree does not kill the root process >

[jira] [Assigned] (AIRFLOW-3134) Add New Operator - MySQLToS3TransformOperator

2018-10-03 Thread Stefano Francavilla (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefano Francavilla reassigned AIRFLOW-3134: Assignee: Stefano Francavilla > Add New Operator -

[jira] [Commented] (AIRFLOW-949) kill_process_tree does not kill the root process

2018-10-03 Thread Erik Cederstrand (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-949?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16636570#comment-16636570 ] Erik Cederstrand commented on AIRFLOW-949: -- Closing as this seems fixed by AIRFLOW-1109 >

[GitHub] codecov-io edited a comment on issue #3989: [AIRFLOW-1945] Autoscale celery workers for airflow added

2018-10-03 Thread GitBox
codecov-io edited a comment on issue #3989: [AIRFLOW-1945] Autoscale celery workers for airflow added URL: https://github.com/apache/incubator-airflow/pull/3989#issuecomment-426543786 # [Codecov](https://codecov.io/gh/apache/incubator-airflow/pull/3989?src=pr=h1) Report > Merging

[GitHub] codecov-io commented on issue #3989: [AIRFLOW-1945] Autoscale celery workers for airflow added

2018-10-03 Thread GitBox
codecov-io commented on issue #3989: [AIRFLOW-1945] Autoscale celery workers for airflow added URL: https://github.com/apache/incubator-airflow/pull/3989#issuecomment-426543786 # [Codecov](https://codecov.io/gh/apache/incubator-airflow/pull/3989?src=pr=h1) Report > Merging

[GitHub] simonvanderveldt commented on issue #3504: [AIRFLOW-2310]: Add AWS Glue Job Compatibility to Airflow

2018-10-03 Thread GitBox
simonvanderveldt commented on issue #3504: [AIRFLOW-2310]: Add AWS Glue Job Compatibility to Airflow URL: https://github.com/apache/incubator-airflow/pull/3504#issuecomment-426541089 @OElesin Have you been able to make any progress on this? There's one duplicate file in there

[jira] [Created] (AIRFLOW-3145) reduce airflow dag scheduling latency in production

2018-10-03 Thread jack (JIRA)
jack created AIRFLOW-3145: - Summary: reduce airflow dag scheduling latency in production Key: AIRFLOW-3145 URL: https://issues.apache.org/jira/browse/AIRFLOW-3145 Project: Apache Airflow Issue Type:

[jira] [Commented] (AIRFLOW-3136) Scheduler Failing the Task retries run while processing Executor Events

2018-10-03 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3136?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16636546#comment-16636546 ] ASF GitHub Bot commented on AIRFLOW-3136: - vardancse opened a new pull request #3994:

[jira] [Commented] (AIRFLOW-1354) www/views.py pool_link produces wrong link

2018-10-03 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-1354?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16636545#comment-16636545 ] ASF GitHub Bot commented on AIRFLOW-1354: - ecederstrand opened a new pull request #3993:

[GitHub] vardancse opened a new pull request #3994: [AIRFLOW-3136] Add retry_number to TaskInstance Key property to avoid race condition

2018-10-03 Thread GitBox
vardancse opened a new pull request #3994: [AIRFLOW-3136] Add retry_number to TaskInstance Key property to avoid race condition URL: https://github.com/apache/incubator-airflow/pull/3994 Make sure you have checked _all_ steps below. ### Jira - [ ] My PR addresses the

[GitHub] ecederstrand opened a new pull request #3993: [AIRFLOW-1354] Fix pool_link() return value

2018-10-03 Thread GitBox
ecederstrand opened a new pull request #3993: [AIRFLOW-1354] Fix pool_link() return value URL: https://github.com/apache/incubator-airflow/pull/3993 The URL had a copy-paste error Make sure you have checked _all_ steps below. ### Jira - [x] My PR addresses the