[GitHub] tedmiston commented on issue #3703: [AIRFLOW-2857] Fix broken RTD env

2018-08-07 Thread GitBox
tedmiston commented on issue #3703: [AIRFLOW-2857] Fix broken RTD env URL: https://github.com/apache/incubator-airflow/pull/3703#issuecomment-411272356 Hey all - It looks like our RTD build post-merge was successful.  I dug into the mock dependency etc in the RTD build environment

[jira] [Created] (AIRFLOW-2871) Harden and improve Read the Docs build environment

2018-08-07 Thread Taylor Edmiston (JIRA)
Taylor Edmiston created AIRFLOW-2871: Summary: Harden and improve Read the Docs build environment Key: AIRFLOW-2871 URL: https://issues.apache.org/jira/browse/AIRFLOW-2871 Project: Apache Airflow

[jira] [Commented] (AIRFLOW-1410) BigQuery Operator flattens the repeated column and it's not configurable

2018-08-07 Thread Iuliia Volkova (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-1410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16572579#comment-16572579 ] Iuliia Volkova commented on AIRFLOW-1410: - '[AIRFLOW-1404] Add 'flatten_results' &

[GitHub] xnuinside edited a comment on issue #3717: [AIRFLOW-1874] use_legacy_sql added to BigQueryCheck operators

2018-08-07 Thread GitBox
xnuinside edited a comment on issue #3717: [AIRFLOW-1874] use_legacy_sql added to BigQueryCheck operators URL: https://github.com/apache/incubator-airflow/pull/3717#issuecomment-411263370 apt-get install failed

[GitHub] xnuinside commented on issue #3717: [AIRFLOW-1874] use_legacy_sql added to BigQueryCheck operators

2018-08-07 Thread GitBox
xnuinside commented on issue #3717: [AIRFLOW-1874] use_legacy_sql added to BigQueryCheck operators URL: https://github.com/apache/incubator-airflow/pull/3717#issuecomment-411263370 apt-get install failed $ cat ~/apt-get-update.log Ign:1 http://repo.mongodb.org/apt/ubuntu

[jira] [Commented] (AIRFLOW-1503) AssertionError: INTERNAL: No default project is specified

2018-08-07 Thread Iuliia Volkova (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-1503?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16572578#comment-16572578 ] Iuliia Volkova commented on AIRFLOW-1503: - @ :param destination_dataset_table: A dotted (.|:).

[GitHub] xnuinside commented on a change in pull request #3714: [AIRFLOW-2867] Refactor code to conform Python standards & guidelines

2018-08-07 Thread GitBox
xnuinside commented on a change in pull request #3714: [AIRFLOW-2867] Refactor code to conform Python standards & guidelines URL: https://github.com/apache/incubator-airflow/pull/3714#discussion_r208438535 ## File path: airflow/contrib/hooks/bigquery_hook.py ## @@ -238,6

[jira] [Resolved] (AIRFLOW-2836) Minor improvement of contrib.sensors.FileSensor

2018-08-07 Thread Xiaodong DENG (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2836?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaodong DENG resolved AIRFLOW-2836. Resolution: Fixed > Minor improvement of contrib.sensors.FileSensor >

[jira] [Resolved] (AIRFLOW-2855) Need to Check Validity of Cron Expression When Process DAG File/Zip File

2018-08-07 Thread Xiaodong DENG (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2855?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaodong DENG resolved AIRFLOW-2855. Resolution: Fixed > Need to Check Validity of Cron Expression When Process DAG File/Zip

[jira] [Commented] (AIRFLOW-2848) dag_id is missing in metadata table "job" for LocalTaskJob

2018-08-07 Thread Xiaodong DENG (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2848?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16572561#comment-16572561 ] Xiaodong DENG commented on AIRFLOW-2848: Thanks [~xnuinside] for reminding. Have closed this

[jira] [Closed] (AIRFLOW-2848) dag_id is missing in metadata table "job" for LocalTaskJob

2018-08-07 Thread Xiaodong DENG (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2848?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaodong DENG closed AIRFLOW-2848. -- Resolution: Fixed > dag_id is missing in metadata table "job" for LocalTaskJob >

[jira] [Assigned] (AIRFLOW-491) Add cache parameter in BigQuery query method

2018-08-07 Thread Iuliia Volkova (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-491?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Iuliia Volkova reassigned AIRFLOW-491: -- Assignee: Iuliia Volkova > Add cache parameter in BigQuery query method >

[GitHub] codecov-io commented on issue #3717: [AIRFLOW-1874] use_legacy_sql added to BigQueryCheck operators

2018-08-07 Thread GitBox
codecov-io commented on issue #3717: [AIRFLOW-1874] use_legacy_sql added to BigQueryCheck operators URL: https://github.com/apache/incubator-airflow/pull/3717#issuecomment-411257030 # [Codecov](https://codecov.io/gh/apache/incubator-airflow/pull/3717?src=pr=h1) Report > Merging

[GitHub] yrqls21 commented on issue #3698: [AIRFLOW-2855] Check Cron Expression Validity in DagBag.process_file()

2018-08-07 Thread GitBox
yrqls21 commented on issue #3698: [AIRFLOW-2855] Check Cron Expression Validity in DagBag.process_file() URL: https://github.com/apache/incubator-airflow/pull/3698#issuecomment-411255565 TY @feng-tao! This is an automated

[jira] [Comment Edited] (AIRFLOW-1874) Support standard SQL in Check, ValueCheck and IntervalCheck BigQuery operators

2018-08-07 Thread Iuliia Volkova (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-1874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16572530#comment-16572530 ] Iuliia Volkova edited comment on AIRFLOW-1874 at 8/8/18 1:13 AM: -

[jira] [Commented] (AIRFLOW-1874) Support standard SQL in Check, ValueCheck and IntervalCheck BigQuery operators

2018-08-07 Thread Iuliia Volkova (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-1874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16572530#comment-16572530 ] Iuliia Volkova commented on AIRFLOW-1874: - [~kaxilnaik],

[jira] [Commented] (AIRFLOW-1874) Support standard SQL in Check, ValueCheck and IntervalCheck BigQuery operators

2018-08-07 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-1874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16572529#comment-16572529 ] ASF GitHub Bot commented on AIRFLOW-1874: - xnuinside opened a new pull request #3717:

[GitHub] xnuinside opened a new pull request #3717: [AIRFLOW-1874] use_legacy_sql added to BigQueryCheck operators

2018-08-07 Thread GitBox
xnuinside opened a new pull request #3717: [AIRFLOW-1874] use_legacy_sql added to BigQueryCheck operators URL: https://github.com/apache/incubator-airflow/pull/3717 Hi everyone! I saw the old task relative to my current work scope and decide to do this little PR ) Just adding

[GitHub] feng-tao commented on issue #3698: [AIRFLOW-2855] Check Cron Expression Validity in DagBag.process_file()

2018-08-07 Thread GitBox
feng-tao commented on issue #3698: [AIRFLOW-2855] Check Cron Expression Validity in DagBag.process_file() URL: https://github.com/apache/incubator-airflow/pull/3698#issuecomment-411251048 thanks @XD-DENG @yrqls21 This is

[jira] [Commented] (AIRFLOW-2855) Need to Check Validity of Cron Expression When Process DAG File/Zip File

2018-08-07 Thread ASF subversion and git services (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2855?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16572528#comment-16572528 ] ASF subversion and git services commented on AIRFLOW-2855: -- Commit

[GitHub] feng-tao closed pull request #3698: [AIRFLOW-2855] Check Cron Expression Validity in DagBag.process_file()

2018-08-07 Thread GitBox
feng-tao closed pull request #3698: [AIRFLOW-2855] Check Cron Expression Validity in DagBag.process_file() URL: https://github.com/apache/incubator-airflow/pull/3698 This is a PR merged from a forked repository. As GitHub hides the original diff on merge, it is displayed below for the

[jira] [Commented] (AIRFLOW-2855) Need to Check Validity of Cron Expression When Process DAG File/Zip File

2018-08-07 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2855?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16572527#comment-16572527 ] ASF GitHub Bot commented on AIRFLOW-2855: - feng-tao closed pull request #3698: [AIRFLOW-2855]

[jira] [Assigned] (AIRFLOW-1874) Support standard SQL in Check, ValueCheck and IntervalCheck BigQuery operators

2018-08-07 Thread Iuliia Volkova (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-1874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Iuliia Volkova reassigned AIRFLOW-1874: --- Assignee: Iuliia Volkova (was: Guillermo Rodríguez Cano) > Support standard SQL

[jira] [Commented] (AIRFLOW-2848) dag_id is missing in metadata table "job" for LocalTaskJob

2018-08-07 Thread Iuliia Volkova (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2848?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16572512#comment-16572512 ] Iuliia Volkova commented on AIRFLOW-2848: - [~XD-DENG]  seems like it's already done) just

[GitHub] codecov-io edited a comment on issue #3698: [AIRFLOW-2855] Check Cron Expression Validity in DagBag.process_file()

2018-08-07 Thread GitBox
codecov-io edited a comment on issue #3698: [AIRFLOW-2855] Check Cron Expression Validity in DagBag.process_file() URL: https://github.com/apache/incubator-airflow/pull/3698#issuecomment-410575101 # [Codecov](https://codecov.io/gh/apache/incubator-airflow/pull/3698?src=pr=h1) Report

[GitHub] codecov-io edited a comment on issue #3698: [AIRFLOW-2855] Check Cron Expression Validity in DagBag.process_file()

2018-08-07 Thread GitBox
codecov-io edited a comment on issue #3698: [AIRFLOW-2855] Check Cron Expression Validity in DagBag.process_file() URL: https://github.com/apache/incubator-airflow/pull/3698#issuecomment-410575101 # [Codecov](https://codecov.io/gh/apache/incubator-airflow/pull/3698?src=pr=h1) Report

[GitHub] troychen728 commented on a change in pull request #3658: [AIRFLOW-2524] Add Amazon SageMaker Training

2018-08-07 Thread GitBox
troychen728 commented on a change in pull request #3658: [AIRFLOW-2524] Add Amazon SageMaker Training URL: https://github.com/apache/incubator-airflow/pull/3658#discussion_r208422276 ## File path: airflow/contrib/operators/sagemaker_create_training_job_operator.py ## @@

[GitHub] XD-DENG commented on a change in pull request #3698: [AIRFLOW-2855] Check Cron Expression Validity in DagBag.process_file()

2018-08-07 Thread GitBox
XD-DENG commented on a change in pull request #3698: [AIRFLOW-2855] Check Cron Expression Validity in DagBag.process_file() URL: https://github.com/apache/incubator-airflow/pull/3698#discussion_r208416023 ## File path: tests/models.py ## @@ -56,7 +56,7 @@ from

[jira] [Commented] (AIRFLOW-2867) Airflow Python Code not compatible to coding guidelines and standards

2018-08-07 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2867?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16572471#comment-16572471 ] ASF GitHub Bot commented on AIRFLOW-2867: - feng-tao closed pull request #3714: [AIRFLOW-2867]

[GitHub] feng-tao closed pull request #3714: [AIRFLOW-2867] Refactor code to conform Python standards & guidelines

2018-08-07 Thread GitBox
feng-tao closed pull request #3714: [AIRFLOW-2867] Refactor code to conform Python standards & guidelines URL: https://github.com/apache/incubator-airflow/pull/3714 This is a PR merged from a forked repository. As GitHub hides the original diff on merge, it is displayed below for the

[GitHub] codecov-io commented on issue #3714: [AIRFLOW-2867] Refactor code to conform Python standards & guidelines

2018-08-07 Thread GitBox
codecov-io commented on issue #3714: [AIRFLOW-2867] Refactor code to conform Python standards & guidelines URL: https://github.com/apache/incubator-airflow/pull/3714#issuecomment-411232814 # [Codecov](https://codecov.io/gh/apache/incubator-airflow/pull/3714?src=pr=h1) Report >

[GitHub] codecov-io commented on issue #3716: [AIRFLOW-2869] Remove smart quote from default config

2018-08-07 Thread GitBox
codecov-io commented on issue #3716: [AIRFLOW-2869] Remove smart quote from default config URL: https://github.com/apache/incubator-airflow/pull/3716#issuecomment-411232064 # [Codecov](https://codecov.io/gh/apache/incubator-airflow/pull/3716?src=pr=h1) Report > Merging

[jira] [Updated] (AIRFLOW-2870) Migrations fail when upgrading from below cc1e65623dc7_add_max_tries_column_to_task_instance

2018-08-07 Thread George Leslie-Waksman (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] George Leslie-Waksman updated AIRFLOW-2870: --- Description: Running migrations from below

[jira] [Updated] (AIRFLOW-2870) Migrations fail when upgrading from below cc1e65623dc7_add_max_tries_column_to_task_instance

2018-08-07 Thread George Leslie-Waksman (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] George Leslie-Waksman updated AIRFLOW-2870: --- Description: Running migrations from below

[GitHub] feng-tao commented on issue #3714: [AIRFLOW-2867] Refactor code to conform Python standards & guidelines

2018-08-07 Thread GitBox
feng-tao commented on issue #3714: [AIRFLOW-2867] Refactor code to conform Python standards & guidelines URL: https://github.com/apache/incubator-airflow/pull/3714#issuecomment-411230444 lgtm This is an automated message

[GitHub] codecov-io edited a comment on issue #3586: [AIRFLOW-2733] Reconcile psutil and subprocess in webserver cli

2018-08-07 Thread GitBox
codecov-io edited a comment on issue #3586: [AIRFLOW-2733] Reconcile psutil and subprocess in webserver cli URL: https://github.com/apache/incubator-airflow/pull/3586#issuecomment-403631506 # [Codecov](https://codecov.io/gh/apache/incubator-airflow/pull/3586?src=pr=h1) Report >

[GitHub] codecov-io edited a comment on issue #3586: [AIRFLOW-2733] Reconcile psutil and subprocess in webserver cli

2018-08-07 Thread GitBox
codecov-io edited a comment on issue #3586: [AIRFLOW-2733] Reconcile psutil and subprocess in webserver cli URL: https://github.com/apache/incubator-airflow/pull/3586#issuecomment-403631506 # [Codecov](https://codecov.io/gh/apache/incubator-airflow/pull/3586?src=pr=h1) Report >

[GitHub] kaxil commented on a change in pull request #3714: [AIRFLOW-2867] Refactor code to conform Python standards & guidelines

2018-08-07 Thread GitBox
kaxil commented on a change in pull request #3714: [AIRFLOW-2867] Refactor code to conform Python standards & guidelines URL: https://github.com/apache/incubator-airflow/pull/3714#discussion_r208411271 ## File path: airflow/contrib/operators/oracle_to_azure_data_lake_transfer.py

[jira] [Commented] (AIRFLOW-2869) Remove smart quote from default config

2018-08-07 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2869?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16572455#comment-16572455 ] ASF GitHub Bot commented on AIRFLOW-2869: - r39132 closed pull request #3716: [AIRFLOW-2869]

[jira] [Resolved] (AIRFLOW-2869) Remove smart quote from default config

2018-08-07 Thread Siddharth Anand (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Anand resolved AIRFLOW-2869. -- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request #3716

[GitHub] r39132 closed pull request #3716: [AIRFLOW-2869] Remove smart quote from default config

2018-08-07 Thread GitBox
r39132 closed pull request #3716: [AIRFLOW-2869] Remove smart quote from default config URL: https://github.com/apache/incubator-airflow/pull/3716 This is a PR merged from a forked repository. As GitHub hides the original diff on merge, it is displayed below for the sake of provenance:

[jira] [Commented] (AIRFLOW-2869) Remove smart quote from default config

2018-08-07 Thread ASF subversion and git services (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2869?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16572453#comment-16572453 ] ASF subversion and git services commented on AIRFLOW-2869: -- Commit

[GitHub] feng-tao commented on a change in pull request #3714: [AIRFLOW-2867] Refactor code to conform Python standards & guidelines

2018-08-07 Thread GitBox
feng-tao commented on a change in pull request #3714: [AIRFLOW-2867] Refactor code to conform Python standards & guidelines URL: https://github.com/apache/incubator-airflow/pull/3714#discussion_r208408841 ## File path: airflow/contrib/operators/oracle_to_azure_data_lake_transfer.py

[jira] [Updated] (AIRFLOW-2869) Remove smart quote from default config

2018-08-07 Thread Siddharth Anand (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Anand updated AIRFLOW-2869: - External issue URL: https://github.com/apache/incubator-airflow/pull/3716 > Remove

[GitHub] feng-tao commented on a change in pull request #3714: [AIRFLOW-2867] Refactor code to conform Python standards & guidelines

2018-08-07 Thread GitBox
feng-tao commented on a change in pull request #3714: [AIRFLOW-2867] Refactor code to conform Python standards & guidelines URL: https://github.com/apache/incubator-airflow/pull/3714#discussion_r208408365 ## File path: airflow/contrib/hooks/databricks_hook.py ## @@ -65,7

[GitHub] r39132 edited a comment on issue #3716: [AIRFLOW-2869] Remove smart quote from default config

2018-08-07 Thread GitBox
r39132 edited a comment on issue #3716: [AIRFLOW-2869] Remove smart quote from default config URL: https://github.com/apache/incubator-airflow/pull/3716#issuecomment-411222958 +1 -- please follow contributor guidelines in the future. I'll create a tracking JIRA and update the JIRA &

[GitHub] feng-tao commented on a change in pull request #3714: [AIRFLOW-2867] Refactor code to conform Python standards & guidelines

2018-08-07 Thread GitBox
feng-tao commented on a change in pull request #3714: [AIRFLOW-2867] Refactor code to conform Python standards & guidelines URL: https://github.com/apache/incubator-airflow/pull/3714#discussion_r208408365 ## File path: airflow/contrib/hooks/databricks_hook.py ## @@ -65,7

[jira] [Created] (AIRFLOW-2870) Migrations fail when upgrading from below cc1e65623dc7_add_max_tries_column_to_task_instance

2018-08-07 Thread George Leslie-Waksman (JIRA)
George Leslie-Waksman created AIRFLOW-2870: -- Summary: Migrations fail when upgrading from below cc1e65623dc7_add_max_tries_column_to_task_instance Key: AIRFLOW-2870 URL:

[jira] [Created] (AIRFLOW-2869) Remove smart quote from default config

2018-08-07 Thread Siddharth Anand (JIRA)
Siddharth Anand created AIRFLOW-2869: Summary: Remove smart quote from default config Key: AIRFLOW-2869 URL: https://issues.apache.org/jira/browse/AIRFLOW-2869 Project: Apache Airflow

[GitHub] r39132 edited a comment on issue #3716: [AIRFLOW-XXX] Remove smart quote from default config

2018-08-07 Thread GitBox
r39132 edited a comment on issue #3716: [AIRFLOW-XXX] Remove smart quote from default config URL: https://github.com/apache/incubator-airflow/pull/3716#issuecomment-411222958 +1 -- please follow contributor guidelines in the future. I'll create a tracking JIRA and update the commit

[GitHub] r39132 commented on issue #3716: [AIRFLOW-XXX] Remove smart quote from default config

2018-08-07 Thread GitBox
r39132 commented on issue #3716: [AIRFLOW-XXX] Remove smart quote from default config URL: https://github.com/apache/incubator-airflow/pull/3716#issuecomment-411222958 +1 This is an automated message from the Apache Git

[GitHub] wdhorton opened a new pull request #3716: [AIRFLOW-XXX] Remove smart quote from default config

2018-08-07 Thread GitBox
wdhorton opened a new pull request #3716: [AIRFLOW-XXX] Remove smart quote from default config URL: https://github.com/apache/incubator-airflow/pull/3716 Make sure you have checked _all_ steps below. ### Jira - [ ] My PR addresses the following [Airflow

[GitHub] feng-tao commented on issue #3708: [AIRFLOW-2859] Implement own UtcDateTime

2018-08-07 Thread GitBox
feng-tao commented on issue #3708: [AIRFLOW-2859] Implement own UtcDateTime URL: https://github.com/apache/incubator-airflow/pull/3708#issuecomment-411222194 flake8 fails. This is an automated message from the Apache Git

[jira] [Commented] (AIRFLOW-1460) Tasks get stuck in the "removed" state

2018-08-07 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-1460?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16572430#comment-16572430 ] ASF GitHub Bot commented on AIRFLOW-1460: - gwax closed pull request #2482: AIRFLOW-1460 clear

[GitHub] gwax commented on issue #2482: AIRFLOW-1460 clear "REMOVED" tis on DagRun update

2018-08-07 Thread GitBox
gwax commented on issue #2482: AIRFLOW-1460 clear "REMOVED" tis on DagRun update URL: https://github.com/apache/incubator-airflow/pull/2482#issuecomment-411221356 This Issue has been resolved by https://github.com/apache/incubator-airflow/pull/3137 I will close this PR as a

[GitHub] gwax closed pull request #2482: AIRFLOW-1460 clear "REMOVED" tis on DagRun update

2018-08-07 Thread GitBox
gwax closed pull request #2482: AIRFLOW-1460 clear "REMOVED" tis on DagRun update URL: https://github.com/apache/incubator-airflow/pull/2482 This is a PR merged from a forked repository. As GitHub hides the original diff on merge, it is displayed below for the sake of provenance: As

[jira] [Resolved] (AIRFLOW-2787) Airflow scheduler dies on DAGs with NULL DagRun run_id

2018-08-07 Thread George Leslie-Waksman (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] George Leslie-Waksman resolved AIRFLOW-2787. Resolution: Fixed > Airflow scheduler dies on DAGs with NULL DagRun

[jira] [Created] (AIRFLOW-2868) Mesos Executor use executor_config to specify CPU, Memory and Docker image on the task level

2018-08-07 Thread Amir Shahatit (JIRA)
Amir Shahatit created AIRFLOW-2868: -- Summary: Mesos Executor use executor_config to specify CPU, Memory and Docker image on the task level Key: AIRFLOW-2868 URL:

[jira] [Updated] (AIRFLOW-2868) Mesos Executor should use executor_config to specify CPU, Memory and Docker image on the task level

2018-08-07 Thread Amir Shahatit (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amir Shahatit updated AIRFLOW-2868: --- Summary: Mesos Executor should use executor_config to specify CPU, Memory and Docker image

[GitHub] bolkedebruin edited a comment on issue #3708: [AIRFLOW-2859] Implement own UtcDateTime

2018-08-07 Thread GitBox
bolkedebruin edited a comment on issue #3708: [AIRFLOW-2859] Implement own UtcDateTime URL: https://github.com/apache/incubator-airflow/pull/3708#issuecomment-411195033 @ashb I think I finally nailed it. The issue was in my understanding how sqlalchemy was dealing with timezone

[GitHub] ashb commented on issue #3708: [AIRFLOW-2859] Implement own UtcDateTime

2018-08-07 Thread GitBox
ashb commented on issue #3708: [AIRFLOW-2859] Implement own UtcDateTime URL: https://github.com/apache/incubator-airflow/pull/3708#issuecomment-411195448 AIP-3: Drop support for Mysql :D This is an automated message

[GitHub] bolkedebruin commented on issue #3708: [AIRFLOW-2859] Implement own UtcDateTime

2018-08-07 Thread GitBox
bolkedebruin commented on issue #3708: [AIRFLOW-2859] Implement own UtcDateTime URL: https://github.com/apache/incubator-airflow/pull/3708#issuecomment-411195033 @ashb I think I finally nailed it. The issue was in my understanding how sqlalchemy was dealing with timezone information

[GitHub] ashb commented on a change in pull request #3714: [AIRFLOW-2867] Refactor code to conform Python standards & guidelines

2018-08-07 Thread GitBox
ashb commented on a change in pull request #3714: [AIRFLOW-2867] Refactor code to conform Python standards & guidelines URL: https://github.com/apache/incubator-airflow/pull/3714#discussion_r208377732 ## File path: tests/core.py ## @@ -2423,7 +2423,7 @@ def

[GitHub] kaxil commented on issue #3714: [AIRFLOW-2867] Refactor code to conform Python standards & guidelines

2018-08-07 Thread GitBox
kaxil commented on issue #3714: [AIRFLOW-2867] Refactor code to conform Python standards & guidelines URL: https://github.com/apache/incubator-airflow/pull/3714#issuecomment-411194032 @ashb This is now ready for review. :)

[GitHub] bolkedebruin closed pull request #3715: [AIRFLOW-XXX] Updating instructions about logging changes in 1.10

2018-08-07 Thread GitBox
bolkedebruin closed pull request #3715: [AIRFLOW-XXX] Updating instructions about logging changes in 1.10 URL: https://github.com/apache/incubator-airflow/pull/3715 This is a PR merged from a forked repository. As GitHub hides the original diff on merge, it is displayed below for the

[GitHub] ashb opened a new pull request #3715: [AIRFLOW-XXX] Updating instructions about logging changes in 1.10

2018-08-07 Thread GitBox
ashb opened a new pull request #3715: [AIRFLOW-XXX] Updating instructions about logging changes in 1.10 URL: https://github.com/apache/incubator-airflow/pull/3715 We had a few other logging changes that weren't mentioned in here that meant previous logs were not viewable anymore.

[GitHub] kaxil commented on issue #3714: [WIP][AIRFLOW-2867] Refactor code to conform Python standards & guidelines

2018-08-07 Thread GitBox
kaxil commented on issue #3714: [WIP][AIRFLOW-2867] Refactor code to conform Python standards & guidelines URL: https://github.com/apache/incubator-airflow/pull/3714#issuecomment-411190182 Hi @ashb, Sorry, I need to sort couple of things here. I have added a WIP flag. Will ping you as

[GitHub] ashb commented on a change in pull request #3714: [AIRFLOW-2867] Refactor code to conform Python standards & guidelines

2018-08-07 Thread GitBox
ashb commented on a change in pull request #3714: [AIRFLOW-2867] Refactor code to conform Python standards & guidelines URL: https://github.com/apache/incubator-airflow/pull/3714#discussion_r208372051 ## File path: airflow/operators/s3_to_hive_operator.py ## @@ -261,9

[GitHub] ashb commented on a change in pull request #3714: [AIRFLOW-2867] Refactor code to conform Python standards & guidelines

2018-08-07 Thread GitBox
ashb commented on a change in pull request #3714: [AIRFLOW-2867] Refactor code to conform Python standards & guidelines URL: https://github.com/apache/incubator-airflow/pull/3714#discussion_r208371591 ## File path: airflow/contrib/operators/dataflow_operator.py ## @@

[GitHub] ashb commented on issue #3708: [AIRFLOW-2859] Implement own UtcDateTime

2018-08-07 Thread GitBox
ashb commented on issue #3708: [AIRFLOW-2859] Implement own UtcDateTime URL: https://github.com/apache/incubator-airflow/pull/3708#issuecomment-411189623 Can I help? This is an automated message from the Apache Git Service.

[GitHub] ashb commented on a change in pull request #3714: [AIRFLOW-2867] Refactor code to conform Python standards & guidelines

2018-08-07 Thread GitBox
ashb commented on a change in pull request #3714: [AIRFLOW-2867] Refactor code to conform Python standards & guidelines URL: https://github.com/apache/incubator-airflow/pull/3714#discussion_r208371167 ## File path: airflow/configuration.py ## @@ -186,7 +186,8 @@ def

[GitHub] ashb commented on a change in pull request #3714: [AIRFLOW-2867] Refactor code to conform Python standards & guidelines

2018-08-07 Thread GitBox
ashb commented on a change in pull request #3714: [AIRFLOW-2867] Refactor code to conform Python standards & guidelines URL: https://github.com/apache/incubator-airflow/pull/3714#discussion_r208371759 ## File path: airflow/contrib/operators/oracle_to_oracle_transfer.py ##

[jira] [Commented] (AIRFLOW-2867) Airflow Python Code not compatible to coding guidelines and standards

2018-08-07 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2867?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16572266#comment-16572266 ] ASF GitHub Bot commented on AIRFLOW-2867: - kaxil opened a new pull request #3714:

[jira] [Created] (AIRFLOW-2867) Airflow Python Code not compatible to coding guidelines and standards

2018-08-07 Thread Kaxil Naik (JIRA)
Kaxil Naik created AIRFLOW-2867: --- Summary: Airflow Python Code not compatible to coding guidelines and standards Key: AIRFLOW-2867 URL: https://issues.apache.org/jira/browse/AIRFLOW-2867 Project:

[GitHub] kaxil edited a comment on issue #3696: [AIRFLOW-2851] Canonicalize "as _..." etc imports

2018-08-07 Thread GitBox
kaxil edited a comment on issue #3696: [AIRFLOW-2851] Canonicalize "as _..." etc imports URL: https://github.com/apache/incubator-airflow/pull/3696#issuecomment-411169973 @mistercrunch 樂 I might have definitely done it on `gcs_hook`. Sorry about that. Not sure if I ever used `_os`.

[GitHub] kaxil commented on issue #3696: [AIRFLOW-2851] Canonicalize "as _..." etc imports

2018-08-07 Thread GitBox
kaxil commented on issue #3696: [AIRFLOW-2851] Canonicalize "as _..." etc imports URL: https://github.com/apache/incubator-airflow/pull/3696#issuecomment-411169973 @mistercrunch 樂 I might have definitely done it on `gcs_hook`. Sorry about that. Not sure if I ever use `_os`.

[jira] [Commented] (AIRFLOW-2851) Canonicalize "as _..." etc imports

2018-08-07 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16572155#comment-16572155 ] ASF GitHub Bot commented on AIRFLOW-2851: - mistercrunch closed pull request #3696:

[jira] [Commented] (AIRFLOW-2851) Canonicalize "as _..." etc imports

2018-08-07 Thread ASF subversion and git services (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16572156#comment-16572156 ] ASF subversion and git services commented on AIRFLOW-2851: -- Commit

[GitHub] mistercrunch closed pull request #3696: [AIRFLOW-2851] Canonicalize "as _..." etc imports

2018-08-07 Thread GitBox
mistercrunch closed pull request #3696: [AIRFLOW-2851] Canonicalize "as _..." etc imports URL: https://github.com/apache/incubator-airflow/pull/3696 This is a PR merged from a forked repository. As GitHub hides the original diff on merge, it is displayed below for the sake of provenance:

[GitHub] mistercrunch commented on issue #3696: [AIRFLOW-2851] Canonicalize "as _..." etc imports

2018-08-07 Thread GitBox
mistercrunch commented on issue #3696: [AIRFLOW-2851] Canonicalize "as _..." etc imports URL: https://github.com/apache/incubator-airflow/pull/3696#issuecomment-411163359 I'm unclear as to why contributors went around their way to alias imports, but it appears to be 100% unnecessary.

[jira] [Created] (AIRFLOW-2866) Missing CSRF Token Error on Web UI Create/Update Operations

2018-08-07 Thread Jasper Kahn (JIRA)
Jasper Kahn created AIRFLOW-2866: Summary: Missing CSRF Token Error on Web UI Create/Update Operations Key: AIRFLOW-2866 URL: https://issues.apache.org/jira/browse/AIRFLOW-2866 Project: Apache

[jira] [Created] (AIRFLOW-2865) Race condition between on_success_callback and LocalTaskJob's cleanup

2018-08-07 Thread Marcin Mejran (JIRA)
Marcin Mejran created AIRFLOW-2865: -- Summary: Race condition between on_success_callback and LocalTaskJob's cleanup Key: AIRFLOW-2865 URL: https://issues.apache.org/jira/browse/AIRFLOW-2865 Project:

[jira] [Commented] (AIRFLOW-2140) Add Kubernetes Scheduler to Spark Submit Operator

2018-08-07 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16572143#comment-16572143 ] ASF GitHub Bot commented on AIRFLOW-2140: - bolkedebruin closed pull request #3700:

[jira] [Commented] (AIRFLOW-2140) Add Kubernetes Scheduler to Spark Submit Operator

2018-08-07 Thread ASF subversion and git services (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16572144#comment-16572144 ] ASF subversion and git services commented on AIRFLOW-2140: -- Commit

[GitHub] bolkedebruin closed pull request #3700: [AIRFLOW-2140] Don't require kubernetes for the SparkSubmit hook

2018-08-07 Thread GitBox
bolkedebruin closed pull request #3700: [AIRFLOW-2140] Don't require kubernetes for the SparkSubmit hook URL: https://github.com/apache/incubator-airflow/pull/3700 This is a PR merged from a forked repository. As GitHub hides the original diff on merge, it is displayed below for the sake

[GitHub] jakahn commented on issue #3677: [AIRFLOW-2826] Add GoogleCloudKMSHook

2018-08-07 Thread GitBox
jakahn commented on issue #3677: [AIRFLOW-2826] Add GoogleCloudKMSHook URL: https://github.com/apache/incubator-airflow/pull/3677#issuecomment-411156427 @Fokko PTAL when you can This is an automated message from the Apache

[jira] [Commented] (AIRFLOW-852) Docs: Cancel a triggered dag

2018-08-07 Thread Quijano Flores (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-852?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16572113#comment-16572113 ] Quijano Flores commented on AIRFLOW-852: I get an error when I do this [~salad_king]

[GitHub] tedmiston commented on issue #3696: [AIRFLOW-2851] Canonicalize "as _..." etc imports

2018-08-07 Thread GitBox
tedmiston commented on issue #3696: [AIRFLOW-2851] Canonicalize "as _..." etc imports URL: https://github.com/apache/incubator-airflow/pull/3696#issuecomment-411139302 Thank you both for the review and initial comments! It sounds like the next step here is probably to get a quick

[GitHub] verdan commented on issue #3656: [WIP][AIRFLOW-2803] Fix all ESLint issues

2018-08-07 Thread GitBox
verdan commented on issue #3656: [WIP][AIRFLOW-2803] Fix all ESLint issues URL: https://github.com/apache/incubator-airflow/pull/3656#issuecomment-411138672 @tedmiston sounds good to me!!  This is an automated message from

[GitHub] tedmiston commented on issue #3587: [WIP][AIRFLOW-2732] Remove hooks and operators from core

2018-08-07 Thread GitBox
tedmiston commented on issue #3587: [WIP][AIRFLOW-2732] Remove hooks and operators from core URL: https://github.com/apache/incubator-airflow/pull/3587#issuecomment-411135195 Closing this PR for now as the next step for this issue is drafting an AIP.

[GitHub] tedmiston commented on issue #3656: [WIP][AIRFLOW-2803] Fix all ESLint issues

2018-08-07 Thread GitBox
tedmiston commented on issue #3656: [WIP][AIRFLOW-2803] Fix all ESLint issues URL: https://github.com/apache/incubator-airflow/pull/3656#issuecomment-411134901 Hey all - thanks for bumping. Sorry for any delay here — my work sprint has been quite busy this past week. This PR is

[jira] [Commented] (AIRFLOW-2863) GKEClusterHook catches wrong exception

2018-08-07 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2863?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16571966#comment-16571966 ] ASF GitHub Bot commented on AIRFLOW-2863: - feng-tao closed pull request #3711: [AIRFLOW-2863]

[jira] [Commented] (AIRFLOW-2863) GKEClusterHook catches wrong exception

2018-08-07 Thread ASF subversion and git services (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2863?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16571967#comment-16571967 ] ASF subversion and git services commented on AIRFLOW-2863: -- Commit

[GitHub] feng-tao closed pull request #3711: [AIRFLOW-2863] Fix GKEClusterHook catching wrong exception

2018-08-07 Thread GitBox
feng-tao closed pull request #3711: [AIRFLOW-2863] Fix GKEClusterHook catching wrong exception URL: https://github.com/apache/incubator-airflow/pull/3711 This is a PR merged from a forked repository. As GitHub hides the original diff on merge, it is displayed below for the sake of

[GitHub] feng-tao commented on issue #3711: [AIRFLOW-2863] Fix GKEClusterHook catching wrong exception

2018-08-07 Thread GitBox
feng-tao commented on issue #3711: [AIRFLOW-2863] Fix GKEClusterHook catching wrong exception URL: https://github.com/apache/incubator-airflow/pull/3711#issuecomment-411127557 LGTM This is an automated message from the

[GitHub] Noremac201 commented on issue #3711: [AIRFLOW-2863] Fix GKEClusterHook catching wrong exception

2018-08-07 Thread GitBox
Noremac201 commented on issue #3711: [AIRFLOW-2863] Fix GKEClusterHook catching wrong exception URL: https://github.com/apache/incubator-airflow/pull/3711#issuecomment-49591 Done! Thanks This is an automated message

[GitHub] awelsh93 commented on issue #3710: [AIRFLOW-2860] Update tests for druid hook

2018-08-07 Thread GitBox
awelsh93 commented on issue #3710: [AIRFLOW-2860] Update tests for druid hook URL: https://github.com/apache/incubator-airflow/pull/3710#issuecomment-47114 Thanks for merging this - can the change in #3707 get another review please? It was merged but then reverted due to tests failing

[GitHub] feng-tao commented on a change in pull request #3698: [AIRFLOW-2855] Check Cron Expression Validity in DagBag.process_file()

2018-08-07 Thread GitBox
feng-tao commented on a change in pull request #3698: [AIRFLOW-2855] Check Cron Expression Validity in DagBag.process_file() URL: https://github.com/apache/incubator-airflow/pull/3698#discussion_r208296250 ## File path: tests/models.py ## @@ -56,7 +56,7 @@ from

[GitHub] ashb commented on a change in pull request #3713: [AIRFLOW-2428] Add AutoScalingRole key to emr_hook

2018-08-07 Thread GitBox
ashb commented on a change in pull request #3713: [AIRFLOW-2428] Add AutoScalingRole key to emr_hook URL: https://github.com/apache/incubator-airflow/pull/3713#discussion_r208267811 ## File path: airflow/contrib/hooks/emr_hook.py ## @@ -63,6 +63,8 @@ def

[jira] [Commented] (AIRFLOW-2428) Add AutoScalingRole key to emr_hook

2018-08-07 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16571799#comment-16571799 ] ASF GitHub Bot commented on AIRFLOW-2428: - dmnpignaud opened a new pull request #3713:

  1   2   >