[GitHub] dimberman commented on issue #3770: [AIRFLOW-3281] Fix Kubernetes operator with git-sync

2018-12-06 Thread GitBox
dimberman commented on issue #3770: [AIRFLOW-3281] Fix Kubernetes operator with git-sync URL: https://github.com/apache/incubator-airflow/pull/3770#issuecomment-445102544 Interesting. Seems that changing ownership of .minikube isn't allowed on macs ```+ sudo chown -R airflow.airflow .

[jira] [Commented] (AIRFLOW-2229) Scheduler cannot retry abrupt task failures within factory-generated DAGs

2018-12-06 Thread Terrence Szymanski (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2229?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16712299#comment-16712299 ] Terrence Szymanski commented on AIRFLOW-2229: - Also getting these errors and I agree the

[GitHub] codecov-io edited a comment on issue #3930: [AIRFLOW-2548] Output plugin import errors to web UI

2018-12-06 Thread GitBox
codecov-io edited a comment on issue #3930: [AIRFLOW-2548] Output plugin import errors to web UI URL: https://github.com/apache/incubator-airflow/pull/3930#issuecomment-445096814 # [Codecov](https://codecov.io/gh/apache/incubator-airflow/pull/3930?src=pr=h1) Report > Merging

[GitHub] codecov-io commented on issue #3930: [AIRFLOW-2548] Output plugin import errors to web UI

2018-12-06 Thread GitBox
codecov-io commented on issue #3930: [AIRFLOW-2548] Output plugin import errors to web UI URL: https://github.com/apache/incubator-airflow/pull/3930#issuecomment-445096814 # [Codecov](https://codecov.io/gh/apache/incubator-airflow/pull/3930?src=pr=h1) Report > Merging

[GitHub] ybendana opened a new pull request #4291: [AIRFLOW-1488] Add the DagRunSensor operator

2018-12-06 Thread GitBox
ybendana opened a new pull request #4291: [AIRFLOW-1488] Add the DagRunSensor operator URL: https://github.com/apache/incubator-airflow/pull/4291 ExternalTaskSensor allows one to wait on any valid combination of (dag_id, task_id). It is desirable though to be able to wait on entire

[GitHub] dimberman commented on issue #3770: [AIRFLOW-3281] Fix Kubernetes operator with git-sync

2018-12-06 Thread GitBox
dimberman commented on issue #3770: [AIRFLOW-3281] Fix Kubernetes operator with git-sync URL: https://github.com/apache/incubator-airflow/pull/3770#issuecomment-445099010 @odracci @Fokko are either of you able to actually run the docker-compose based integration tests on your local

[jira] [Assigned] (AIRFLOW-2508) Handle non string types in render_template_from_field

2018-12-06 Thread Galak (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2508?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Galak reassigned AIRFLOW-2508: -- Assignee: Galak (was: Eugene Brown) > Handle non string types in render_template_from_field >

[jira] [Commented] (AIRFLOW-1488) Add a sensor operator to wait on DagRuns

2018-12-06 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-1488?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16712260#comment-16712260 ] ASF GitHub Bot commented on AIRFLOW-1488: - ybendana opened a new pull request #4291:

[GitHub] dimberman commented on issue #3770: [AIRFLOW-3281] Fix Kubernetes operator with git-sync

2018-12-06 Thread GitBox
dimberman commented on issue #3770: [AIRFLOW-3281] Fix Kubernetes operator with git-sync URL: https://github.com/apache/incubator-airflow/pull/3770#issuecomment-445099589 I think those might be because I was in the wrong directory. Gonna try to make a PR to simplify local development if

[GitHub] jzucker2 commented on a change in pull request #3770: [AIRFLOW-3281] Fix Kubernetes operator with git-sync

2018-12-06 Thread GitBox
jzucker2 commented on a change in pull request #3770: [AIRFLOW-3281] Fix Kubernetes operator with git-sync URL: https://github.com/apache/incubator-airflow/pull/3770#discussion_r23968 ## File path: airflow/contrib/kubernetes/worker_configuration.py ## @@ -50,13 +55,13

[GitHub] jzucker2 commented on a change in pull request #3770: [AIRFLOW-3281] Fix Kubernetes operator with git-sync

2018-12-06 Thread GitBox
jzucker2 commented on a change in pull request #3770: [AIRFLOW-3281] Fix Kubernetes operator with git-sync URL: https://github.com/apache/incubator-airflow/pull/3770#discussion_r239688963 ## File path: airflow/contrib/kubernetes/worker_configuration.py ## @@ -89,11

[jira] [Commented] (AIRFLOW-1490) In order to get details on exceptions thrown by tasks, the onfailure callback needs an enhancement

2018-12-06 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-1490?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16711477#comment-16711477 ] jack commented on AIRFLOW-1490: --- You can prepare PR with your code suggestions > In order to get details

[jira] [Commented] (AIRFLOW-1405) Airflow v 1.8.1 unable to properly initialize with MySQL

2018-12-06 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-1405?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16711385#comment-16711385 ] jack commented on AIRFLOW-1405: --- I think the best solution for this is for Airflow to catch this

[GitHub] feng-tao commented on a change in pull request #4287: [AIRFLOW-3479] Keeps records in Log Table when delete DAG & refine related tests

2018-12-06 Thread GitBox
feng-tao commented on a change in pull request #4287: [AIRFLOW-3479] Keeps records in Log Table when delete DAG & refine related tests URL: https://github.com/apache/incubator-airflow/pull/4287#discussion_r239715180 ## File path: airflow/api/common/experimental/delete_dag.py

[GitHub] XD-DENG commented on issue #4287: [AIRFLOW-3479] Keeps records in Log Table when delete DAG & refine related tests

2018-12-06 Thread GitBox
XD-DENG commented on issue #4287: [AIRFLOW-3479] Keeps records in Log Table when delete DAG & refine related tests URL: https://github.com/apache/incubator-airflow/pull/4287#issuecomment-444920407 1 test (Py35-sqlite) failed due to transient error. May you help re-trigger it? @ashb

[GitHub] potiuk commented on issue #4284: [AIRFLOW-3433] Create Google Cloud Spanner Hook

2018-12-06 Thread GitBox
potiuk commented on issue #4284: [AIRFLOW-3433] Create Google Cloud Spanner Hook URL: https://github.com/apache/incubator-airflow/pull/4284#issuecomment-444927988 Hello @ryanyuan . Are you sure you want to work on this in parallel to our work :)? We are just about to get merged (with

[GitHub] XD-DENG removed a comment on issue #4287: [AIRFLOW-3479] Keeps records in Log Table when delete DAG & refine related tests

2018-12-06 Thread GitBox
XD-DENG removed a comment on issue #4287: [AIRFLOW-3479] Keeps records in Log Table when delete DAG & refine related tests URL: https://github.com/apache/incubator-airflow/pull/4287#issuecomment-444920576 1 test (Py35-sqlite) failed due to transient error. May you help re-trigger it?

[jira] [Created] (AIRFLOW-3480) Google Cloud Spanner Instance Database Deploy/Update/Delete

2018-12-06 Thread Jarek Potiuk (JIRA)
Jarek Potiuk created AIRFLOW-3480: - Summary: Google Cloud Spanner Instance Database Deploy/Update/Delete Key: AIRFLOW-3480 URL: https://issues.apache.org/jira/browse/AIRFLOW-3480 Project: Apache

[GitHub] codecov-io commented on issue #4287: [AIRFLOW-3479] Keeps records in Log Table when delete DAG & refine related tests

2018-12-06 Thread GitBox
codecov-io commented on issue #4287: [AIRFLOW-3479] Keeps records in Log Table when delete DAG & refine related tests URL: https://github.com/apache/incubator-airflow/pull/4287#issuecomment-444939775 # [Codecov](https://codecov.io/gh/apache/incubator-airflow/pull/4287?src=pr=h1) Report

[GitHub] XD-DENG commented on issue #4287: [AIRFLOW-3479] Keeps records in Log Table when delete DAG & refine related tests

2018-12-06 Thread GitBox
XD-DENG commented on issue #4287: [AIRFLOW-3479] Keeps records in Log Table when delete DAG & refine related tests URL: https://github.com/apache/incubator-airflow/pull/4287#issuecomment-444920576 1 test (Py35-sqlite) failed due to transient error. May you help re-trigger it? @ashb

[GitHub] feng-tao commented on a change in pull request #4287: [AIRFLOW-3479] Keeps records in Log Table when delete DAG & refine related tests

2018-12-06 Thread GitBox
feng-tao commented on a change in pull request #4287: [AIRFLOW-3479] Keeps records in Log Table when delete DAG & refine related tests URL: https://github.com/apache/incubator-airflow/pull/4287#discussion_r239559313 ## File path: tests/api/common/experimental/test_delete_dag.py

[jira] [Commented] (AIRFLOW-2508) Handle non string types in render_template_from_field

2018-12-06 Thread Galak (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2508?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16711502#comment-16711502 ] Galak commented on AIRFLOW-2508: This issue is partially resolved by AIRFLOW-2415, but only for numeric

[jira] [Created] (AIRFLOW-3479) Records of "Log" table should be kept (by default) when users delete a DAG.

2018-12-06 Thread Xiaodong DENG (JIRA)
Xiaodong DENG created AIRFLOW-3479: -- Summary: Records of "Log" table should be kept (by default) when users delete a DAG. Key: AIRFLOW-3479 URL: https://issues.apache.org/jira/browse/AIRFLOW-3479

[jira] [Resolved] (AIRFLOW-1490) In order to get details on exceptions thrown by tasks, the onfailure callback needs an enhancement

2018-12-06 Thread Ash Berlin-Taylor (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-1490?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ash Berlin-Taylor resolved AIRFLOW-1490. Resolution: Duplicate AIRFLOW-843 merged and in 1.10.1 release > In order to

[jira] [Commented] (AIRFLOW-3479) Records of "Log" table should be kept (by default) when users delete a DAG.

2018-12-06 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3479?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16711565#comment-16711565 ] ASF GitHub Bot commented on AIRFLOW-3479: - XD-DENG opened a new pull request #4287:

[GitHub] ron819 commented on issue #4287: [AIRFLOW-3479] Keeps records in Log Table when delete DAG & refine related tests

2018-12-06 Thread GitBox
ron819 commented on issue #4287: [AIRFLOW-3479] Keeps records in Log Table when delete DAG & refine related tests URL: https://github.com/apache/incubator-airflow/pull/4287#issuecomment-444904587 I can say that for my use case when I delete a dag I have no need for the log table. It

[GitHub] codecov-io edited a comment on issue #4276: [AIRFLOW-1552] Airflow Filter_by_owner not working with password_auth

2018-12-06 Thread GitBox
codecov-io edited a comment on issue #4276: [AIRFLOW-1552] Airflow Filter_by_owner not working with password_auth URL: https://github.com/apache/incubator-airflow/pull/4276#issuecomment-444138570 # [Codecov](https://codecov.io/gh/apache/incubator-airflow/pull/4276?src=pr=h1) Report >

[GitHub] XD-DENG commented on issue #4287: [AIRFLOW-3479] Keeps records in Log Table when delete DAG & refine related tests

2018-12-06 Thread GitBox
XD-DENG commented on issue #4287: [AIRFLOW-3479] Keeps records in Log Table when delete DAG & refine related tests URL: https://github.com/apache/incubator-airflow/pull/4287#issuecomment-444902340 Hi @ashb @kaxil , PTAL. Earlier I asked for your inputs for this on Slack. Cheers.

[GitHub] feng-tao closed pull request #4265: [AIRFLOW-3406] Implement an Azure CosmosDB operator

2018-12-06 Thread GitBox
feng-tao closed pull request #4265: [AIRFLOW-3406] Implement an Azure CosmosDB operator URL: https://github.com/apache/incubator-airflow/pull/4265 This is a PR merged from a forked repository. As GitHub hides the original diff on merge, it is displayed below for the sake of provenance:

[GitHub] feng-tao commented on a change in pull request #4287: [AIRFLOW-3479] Keeps records in Log Table when delete DAG & refine related tests

2018-12-06 Thread GitBox
feng-tao commented on a change in pull request #4287: [AIRFLOW-3479] Keeps records in Log Table when delete DAG & refine related tests URL: https://github.com/apache/incubator-airflow/pull/4287#discussion_r239559208 ## File path: tests/api/common/experimental/test_delete_dag.py

[GitHub] feng-tao commented on a change in pull request #4287: [AIRFLOW-3479] Keeps records in Log Table when delete DAG & refine related tests

2018-12-06 Thread GitBox
feng-tao commented on a change in pull request #4287: [AIRFLOW-3479] Keeps records in Log Table when delete DAG & refine related tests URL: https://github.com/apache/incubator-airflow/pull/4287#discussion_r239559570 ## File path: airflow/api/common/experimental/delete_dag.py

[GitHub] feng-tao commented on issue #4265: [AIRFLOW-3406] Implement an Azure CosmosDB operator

2018-12-06 Thread GitBox
feng-tao commented on issue #4265: [AIRFLOW-3406] Implement an Azure CosmosDB operator URL: https://github.com/apache/incubator-airflow/pull/4265#issuecomment-444975208 thanks @tmiller-msft, merge. This is an automated

[GitHub] dimberman commented on issue #3770: [AIRFLOW-3281] Fix Kubernetes operator with git-sync

2018-12-06 Thread GitBox
dimberman commented on issue #3770: [AIRFLOW-3281] Fix Kubernetes operator with git-sync URL: https://github.com/apache/incubator-airflow/pull/3770#issuecomment-444977780 @odracci would it be ok for @jzucker2 and I to make some PR's against this to get it mergeable? This is a pretty

[jira] [Commented] (AIRFLOW-3406) Implement an Azure CosmosDB operator

2018-12-06 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3406?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16711822#comment-16711822 ] ASF GitHub Bot commented on AIRFLOW-3406: - feng-tao closed pull request #4265: [AIRFLOW-3406]

[GitHub] apraovjr opened a new pull request #4288: [AIRFLOW-3282] Implement an Azure Kubernetes Service Operator

2018-12-06 Thread GitBox
apraovjr opened a new pull request #4288: [AIRFLOW-3282] Implement an Azure Kubernetes Service Operator URL: https://github.com/apache/incubator-airflow/pull/4288 Add an operator to spin up azure kubernetes service. Azure Kubernetes Service is use to deploy a managed kubernetes cluster

[jira] [Commented] (AIRFLOW-3282) Implement a Azure Kubernetes Service Operator

2018-12-06 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16711840#comment-16711840 ] ASF GitHub Bot commented on AIRFLOW-3282: - apraovjr opened a new pull request #4288:

[GitHub] apraovjr closed pull request #4288: [AIRFLOW-3282] Implement an Azure Kubernetes Service Operator

2018-12-06 Thread GitBox
apraovjr closed pull request #4288: [AIRFLOW-3282] Implement an Azure Kubernetes Service Operator URL: https://github.com/apache/incubator-airflow/pull/4288 This is a PR merged from a forked repository. As GitHub hides the original diff on merge, it is displayed below for the sake of

[GitHub] apraovjr closed pull request #4288: [AIRFLOW-3282] Implement an Azure Kubernetes Service Operator

2018-12-06 Thread GitBox
apraovjr closed pull request #4288: [AIRFLOW-3282] Implement an Azure Kubernetes Service Operator URL: https://github.com/apache/incubator-airflow/pull/4288 This is a PR merged from a forked repository. As GitHub hides the original diff on merge, it is displayed below for the sake of

[jira] [Commented] (AIRFLOW-3282) Implement a Azure Kubernetes Service Operator

2018-12-06 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16711853#comment-16711853 ] ASF GitHub Bot commented on AIRFLOW-3282: - apraovjr closed pull request #4288: [AIRFLOW-3282]

[jira] [Commented] (AIRFLOW-3282) Implement a Azure Kubernetes Service Operator

2018-12-06 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16711851#comment-16711851 ] ASF GitHub Bot commented on AIRFLOW-3282: - apraovjr opened a new pull request #4288:

[GitHub] apraovjr opened a new pull request #4288: [AIRFLOW-3282] Implement an Azure Kubernetes Service Operator

2018-12-06 Thread GitBox
apraovjr opened a new pull request #4288: [AIRFLOW-3282] Implement an Azure Kubernetes Service Operator URL: https://github.com/apache/incubator-airflow/pull/4288 Add an operator to spin up azure kubernetes service. Azure Kubernetes Service is use to deploy a managed kubernetes cluster

[jira] [Commented] (AIRFLOW-3282) Implement a Azure Kubernetes Service Operator

2018-12-06 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16711845#comment-16711845 ] ASF GitHub Bot commented on AIRFLOW-3282: - apraovjr closed pull request #4288: [AIRFLOW-3282]

<    1   2