[GitHub] [airflow] aviemzur commented on a change in pull request #6824: [AIRFLOW-6258] add CloudFormation operators to AWS providers

2020-01-22 Thread GitBox
aviemzur commented on a change in pull request #6824: [AIRFLOW-6258] add CloudFormation operators to AWS providers URL: https://github.com/apache/airflow/pull/6824#discussion_r369972454 ## File path: airflow/providers/amazon/aws/sensors/cloud_formation.py ## @@ -0,0 +1,98

[GitHub] [airflow] aviemzur commented on a change in pull request #6824: [AIRFLOW-6258] add CloudFormation operators to AWS providers

2020-01-22 Thread GitBox
aviemzur commented on a change in pull request #6824: [AIRFLOW-6258] add CloudFormation operators to AWS providers URL: https://github.com/apache/airflow/pull/6824#discussion_r369972407 ## File path: airflow/providers/amazon/aws/sensors/cloud_formation.py ## @@ -0,0 +1,98

[GitHub] [airflow] aviemzur commented on a change in pull request #6824: [AIRFLOW-6258] add CloudFormation operators to AWS providers

2020-01-22 Thread GitBox
aviemzur commented on a change in pull request #6824: [AIRFLOW-6258] add CloudFormation operators to AWS providers URL: https://github.com/apache/airflow/pull/6824#discussion_r369972551 ## File path: airflow/providers/amazon/aws/operators/cloud_formation.py ## @@ -0,0

[GitHub] [airflow] aviemzur commented on a change in pull request #6824: [AIRFLOW-6258] add CloudFormation operators to AWS providers

2020-01-22 Thread GitBox
aviemzur commented on a change in pull request #6824: [AIRFLOW-6258] add CloudFormation operators to AWS providers URL: https://github.com/apache/airflow/pull/6824#discussion_r369971519 ## File path: airflow/providers/amazon/aws/operators/cloud_formation.py ## @@ -0,0

[GitHub] [airflow] aviemzur commented on a change in pull request #6824: [AIRFLOW-6258] add CloudFormation operators to AWS providers

2020-01-22 Thread GitBox
aviemzur commented on a change in pull request #6824: [AIRFLOW-6258] add CloudFormation operators to AWS providers URL: https://github.com/apache/airflow/pull/6824#discussion_r369971576 ## File path: airflow/providers/amazon/aws/operators/cloud_formation.py ## @@ -0,0

[GitHub] [airflow] aviemzur commented on a change in pull request #6824: [AIRFLOW-6258] add CloudFormation operators to AWS providers

2020-01-22 Thread GitBox
aviemzur commented on a change in pull request #6824: [AIRFLOW-6258] add CloudFormation operators to AWS providers URL: https://github.com/apache/airflow/pull/6824#discussion_r369971557 ## File path: airflow/providers/amazon/aws/operators/cloud_formation.py ## @@ -0,0

[GitHub] [airflow] nuclearpinguin commented on issue #7241: [AIRFLOW-6617] Add tests to PYTHONPATH in breeze

2020-01-22 Thread GitBox
nuclearpinguin commented on issue #7241: [AIRFLOW-6617] Add tests to PYTHONPATH in breeze URL: https://github.com/apache/airflow/pull/7241#issuecomment-577539102 > Just wondering how it helps ? Not that I am against it but like to see a reason for it and maybe add it for others to the

[GitHub] [airflow] davlum commented on a change in pull request #6230: [AIRFLOW-5413] Allow K8S worker pod to be configured from JSON/YAML file

2020-01-22 Thread GitBox
davlum commented on a change in pull request #6230: [AIRFLOW-5413] Allow K8S worker pod to be configured from JSON/YAML file URL: https://github.com/apache/airflow/pull/6230#discussion_r369930481 ## File path: airflow/kubernetes/pod_generator.py ## @@ -301,51 +352,151 @@

[GitHub] [airflow] yuqian90 edited a comment on issue #7038: [AIRFLOW-4495] Allow externally triggered dags to run for future exec dates

2020-01-22 Thread GitBox
yuqian90 edited a comment on issue #7038: [AIRFLOW-4495] Allow externally triggered dags to run for future exec dates URL: https://github.com/apache/airflow/pull/7038#issuecomment-577471036 > Sorry for the comment spam but I thought it would be important for @yuqian90 > > We have

[GitHub] [airflow] yuqian90 commented on issue #7038: [AIRFLOW-4495] Allow externally triggered dags to run for future exec dates

2020-01-22 Thread GitBox
yuqian90 commented on issue #7038: [AIRFLOW-4495] Allow externally triggered dags to run for future exec dates URL: https://github.com/apache/airflow/pull/7038#issuecomment-577471036 > Sorry for the comment spam but I thought it would be important for @yuqian90 > > We have the

[GitHub] [airflow] houqp commented on issue #6342: [AIRFLOW-5662] fix incorrect naming for scheduler used slot metric

2020-01-22 Thread GitBox
houqp commented on issue #6342: [AIRFLOW-5662] fix incorrect naming for scheduler used slot metric URL: https://github.com/apache/airflow/pull/6342#issuecomment-577457332 @ashb gentle ping for a review :) This is an

[GitHub] [airflow] pingzh commented on a change in pull request #7141: [AIRFLOW-6544] add log_id to end_of_log mark log record

2020-01-22 Thread GitBox
pingzh commented on a change in pull request #7141: [AIRFLOW-6544] add log_id to end_of_log mark log record URL: https://github.com/apache/airflow/pull/7141#discussion_r369881195 ## File path: airflow/utils/log/es_task_handler.py ## @@ -255,7 +256,9 @@ def close(self):

[GitHub] [airflow] pingzh commented on a change in pull request #7141: [AIRFLOW-6544] add log_id to end_of_log mark log record

2020-01-22 Thread GitBox
pingzh commented on a change in pull request #7141: [AIRFLOW-6544] add log_id to end_of_log mark log record URL: https://github.com/apache/airflow/pull/7141#discussion_r369883128 ## File path: airflow/utils/log/es_task_handler.py ## @@ -255,7 +256,9 @@ def close(self):

[GitHub] [airflow] pingzh commented on a change in pull request #7141: [AIRFLOW-6544] add log_id to end_of_log mark log record

2020-01-22 Thread GitBox
pingzh commented on a change in pull request #7141: [AIRFLOW-6544] add log_id to end_of_log mark log record URL: https://github.com/apache/airflow/pull/7141#discussion_r369881195 ## File path: airflow/utils/log/es_task_handler.py ## @@ -255,7 +256,9 @@ def close(self):

[GitHub] [airflow] codecov-io edited a comment on issue #6954: [AIRFLOW-4355] removed task should not lead to dagrun success

2020-01-22 Thread GitBox
codecov-io edited a comment on issue #6954: [AIRFLOW-4355] removed task should not lead to dagrun success URL: https://github.com/apache/airflow/pull/6954#issuecomment-569545898 # [Codecov](https://codecov.io/gh/apache/airflow/pull/6954?src=pr=h1) Report > Merging

[GitHub] [airflow] codecov-io edited a comment on issue #6954: [AIRFLOW-4355] removed task should not lead to dagrun success

2020-01-22 Thread GitBox
codecov-io edited a comment on issue #6954: [AIRFLOW-4355] removed task should not lead to dagrun success URL: https://github.com/apache/airflow/pull/6954#issuecomment-569545898 # [Codecov](https://codecov.io/gh/apache/airflow/pull/6954?src=pr=h1) Report > Merging

[GitHub] [airflow] codecov-io edited a comment on issue #6954: [AIRFLOW-4355] removed task should not lead to dagrun success

2020-01-22 Thread GitBox
codecov-io edited a comment on issue #6954: [AIRFLOW-4355] removed task should not lead to dagrun success URL: https://github.com/apache/airflow/pull/6954#issuecomment-569545898 # [Codecov](https://codecov.io/gh/apache/airflow/pull/6954?src=pr=h1) Report > Merging

[GitHub] [airflow] stale[bot] commented on issue #6211: [AIRFLOW-5569] Improve Pod Launcher Logging

2020-01-22 Thread GitBox
stale[bot] commented on issue #6211: [AIRFLOW-5569] Improve Pod Launcher Logging URL: https://github.com/apache/airflow/pull/6211#issuecomment-577434319 This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity

[GitHub] [airflow] codecov-io edited a comment on issue #5970: [AIRFLOW-2923][AIRFLOW-1784] Implement LatestOnlyOperator as BaseBranchOperator

2020-01-22 Thread GitBox
codecov-io edited a comment on issue #5970: [AIRFLOW-2923][AIRFLOW-1784] Implement LatestOnlyOperator as BaseBranchOperator URL: https://github.com/apache/airflow/pull/5970#issuecomment-571816542 # [Codecov](https://codecov.io/gh/apache/airflow/pull/5970?src=pr=h1) Report > Merging

[GitHub] [airflow] codecov-io edited a comment on issue #6075: [AIRFLOW-5266] Allow aws_athena_hook to get all query results

2020-01-22 Thread GitBox
codecov-io edited a comment on issue #6075: [AIRFLOW-5266] Allow aws_athena_hook to get all query results URL: https://github.com/apache/airflow/pull/6075#issuecomment-561876309 # [Codecov](https://codecov.io/gh/apache/airflow/pull/6075?src=pr=h1) Report > Merging

[GitHub] [airflow] m1racoli commented on issue #5970: [AIRFLOW-2923][AIRFLOW-1784] Implement LatestOnlyOperator as BaseBranchOperator

2020-01-22 Thread GitBox
m1racoli commented on issue #5970: [AIRFLOW-2923][AIRFLOW-1784] Implement LatestOnlyOperator as BaseBranchOperator URL: https://github.com/apache/airflow/pull/5970#issuecomment-577404876 Comments for updating have been added.

[GitHub] [airflow] dimberman commented on a change in pull request #6230: [AIRFLOW-5413] Allow K8S worker pod to be configured from JSON/YAML file

2020-01-22 Thread GitBox
dimberman commented on a change in pull request #6230: [AIRFLOW-5413] Allow K8S worker pod to be configured from JSON/YAML file URL: https://github.com/apache/airflow/pull/6230#discussion_r369817165 ## File path: airflow/kubernetes/pod_generator.py ## @@ -301,51 +352,151

[GitHub] [airflow] m1racoli commented on a change in pull request #5970: [AIRFLOW-2923][AIRFLOW-1784] Implement LatestOnlyOperator as BaseBranchOperator

2020-01-22 Thread GitBox
m1racoli commented on a change in pull request #5970: [AIRFLOW-2923][AIRFLOW-1784] Implement LatestOnlyOperator as BaseBranchOperator URL: https://github.com/apache/airflow/pull/5970#discussion_r369808495 ## File path: docs/concepts.rst ## @@ -1078,15 +1078,14 @@ For

[GitHub] [airflow] vsoch commented on issue #7191: [AIRFLOW-4030] second attempt to add singularity to airflow

2020-01-22 Thread GitBox
vsoch commented on issue #7191: [AIRFLOW-4030] second attempt to add singularity to airflow URL: https://github.com/apache/airflow/pull/7191#issuecomment-577373099 okay, I've taken a look at the docker-compose approach. Specifically, I've created a `integration-singularity.yml` file that

[jira] [Commented] (AIRFLOW-6557) Warn if new fields are added to BaseOperator (for serialization)

2020-01-22 Thread ASF subversion and git services (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6557?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17021474#comment-17021474 ] ASF subversion and git services commented on AIRFLOW-6557: -- Commit

[jira] [Commented] (AIRFLOW-6557) Warn if new fields are added to BaseOperator (for serialization)

2020-01-22 Thread ASF subversion and git services (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6557?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17021470#comment-17021470 ] ASF subversion and git services commented on AIRFLOW-6557: -- Commit

[GitHub] [airflow] milton0825 commented on a change in pull request #6900: [AIRFLOW-6346] Enhance dag default_view and orientation

2020-01-22 Thread GitBox
milton0825 commented on a change in pull request #6900: [AIRFLOW-6346] Enhance dag default_view and orientation URL: https://github.com/apache/airflow/pull/6900#discussion_r369755076 ## File path: airflow/models/dag.py ## @@ -296,8 +298,16 @@ def __init__(

[GitHub] [airflow] vsoch commented on issue #7191: [AIRFLOW-4030] second attempt to add singularity to airflow

2020-01-22 Thread GitBox
vsoch commented on issue #7191: [AIRFLOW-4030] second attempt to add singularity to airflow URL: https://github.com/apache/airflow/pull/7191#issuecomment-577337258 [Here are my thoughts](https://gist.github.com/vsoch/599bd51246c2b2d3da350f97c0916efe) @potiuk, I hope that they are

[jira] [Commented] (AIRFLOW-4113) Unpin boto library

2020-01-22 Thread ASF subversion and git services (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-4113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17021398#comment-17021398 ] ASF subversion and git services commented on AIRFLOW-4113: -- Commit

[jira] [Commented] (AIRFLOW-6496) Choosing integration at Breeze start

2020-01-22 Thread ASF subversion and git services (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6496?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17021375#comment-17021375 ] ASF subversion and git services commented on AIRFLOW-6496: -- Commit

[GitHub] [airflow] potiuk commented on issue #7241: [AIRFLOW-6617] Add tests to PYTHONPATH in breeze

2020-01-22 Thread GitBox
potiuk commented on issue #7241: [AIRFLOW-6617] Add tests to PYTHONPATH in breeze URL: https://github.com/apache/airflow/pull/7241#issuecomment-577319557 Just wondering how it helps ? Not that I am against it but like to see a reason for it and maybe add it for others to the docs how it

[GitHub] [airflow] potiuk commented on issue #5308: [AIRFLOW-4549] skipped tasks should be ok for wait_for_downstream

2020-01-22 Thread GitBox
potiuk commented on issue #5308: [AIRFLOW-4549] skipped tasks should be ok for wait_for_downstream URL: https://github.com/apache/airflow/pull/5308#issuecomment-577317726 No objections. Just static checks failure :( This is

[jira] [Commented] (AIRFLOW-6609) Airflow upgradedb fails serialized_dag table add on revision id d38e04c12aa2

2020-01-22 Thread Chris Schmautz (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6609?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17021345#comment-17021345 ] Chris Schmautz commented on AIRFLOW-6609: - Either checking ahead of table existence before the

[jira] [Commented] (AIRFLOW-6607) Get rid of old local_* scripts in Breeze

2020-01-22 Thread ASF subversion and git services (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6607?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17021335#comment-17021335 ] ASF subversion and git services commented on AIRFLOW-6607: -- Commit

[jira] [Commented] (AIRFLOW-6592) Doc build can be run in parallel to tests in CI

2020-01-22 Thread ASF subversion and git services (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6592?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17021333#comment-17021333 ] ASF subversion and git services commented on AIRFLOW-6592: -- Commit

[jira] [Commented] (AIRFLOW-6589) BATS tests are not executed when bash scripts change in pre-commit

2020-01-22 Thread ASF subversion and git services (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6589?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17021334#comment-17021334 ] ASF subversion and git services commented on AIRFLOW-6589: -- Commit

[airflow-on-k8s-operator] branch master updated: Add Repo name to Readme (#4)

2020-01-22 Thread kaxilnaik
This is an automated email from the ASF dual-hosted git repository. kaxilnaik pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/airflow-on-k8s-operator.git The following commit(s) were added to refs/heads/master by this push: new 830f756 Add Repo name to

[jira] [Resolved] (AIRFLOW-6611) Add missing ProxyFix configs to default_airflow.cfg with docs

2020-01-22 Thread Kaxil Naik (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6611?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kaxil Naik resolved AIRFLOW-6611. - Resolution: Fixed > Add missing ProxyFix configs to default_airflow.cfg with docs >

[jira] [Commented] (AIRFLOW-6611) Add missing ProxyFix configs to default_airflow.cfg with docs

2020-01-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6611?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17021275#comment-17021275 ] ASF GitHub Bot commented on AIRFLOW-6611: - dimberman commented on pull request #7236:

[jira] [Commented] (AIRFLOW-6611) Add missing ProxyFix configs to default_airflow.cfg with docs

2020-01-22 Thread ASF subversion and git services (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6611?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17021277#comment-17021277 ] ASF subversion and git services commented on AIRFLOW-6611: -- Commit

[GitHub] [airflow] dimberman merged pull request #7236: [AIRFLOW-6611] Add proxy_fix configs to default_airflow.cfg

2020-01-22 Thread GitBox
dimberman merged pull request #7236: [AIRFLOW-6611] Add proxy_fix configs to default_airflow.cfg URL: https://github.com/apache/airflow/pull/7236 This is an automated message from the Apache Git Service. To respond to the

[GitHub] [airflow] notatallshaw commented on issue #7038: [AIRFLOW-4495] Allow externally triggered dags to run for future exec dates

2020-01-22 Thread GitBox
notatallshaw commented on issue #7038: [AIRFLOW-4495] Allow externally triggered dags to run for future exec dates URL: https://github.com/apache/airflow/pull/7038#issuecomment-577275156 Sorry for the comment spam but I thought it would be important for @yuqian90 We have the exact

[GitHub] [airflow] mschickensoup commented on a change in pull request #7204: [AIRFLOW-XXXX] - add communication chapter to contributing

2020-01-22 Thread GitBox
mschickensoup commented on a change in pull request #7204: [AIRFLOW-] - add communication chapter to contributing URL: https://github.com/apache/airflow/pull/7204#discussion_r369121248 ## File path: CONTRIBUTING.rst ## @@ -664,6 +664,73 @@ Later on above depending

[GitHub] [airflow] mschickensoup commented on a change in pull request #7204: [AIRFLOW-XXXX] - add communication chapter to contributing

2020-01-22 Thread GitBox
mschickensoup commented on a change in pull request #7204: [AIRFLOW-] - add communication chapter to contributing URL: https://github.com/apache/airflow/pull/7204#discussion_r369505260 ## File path: CONTRIBUTING.rst ## @@ -664,6 +664,73 @@ Later on above depending

[GitHub] [airflow] mschickensoup commented on a change in pull request #7204: [AIRFLOW-XXXX] - add communication chapter to contributing

2020-01-22 Thread GitBox
mschickensoup commented on a change in pull request #7204: [AIRFLOW-] - add communication chapter to contributing URL: https://github.com/apache/airflow/pull/7204#discussion_r369634841 ## File path: CONTRIBUTING.rst ## @@ -664,6 +664,73 @@ Later on above depending

[GitHub] [airflow] mschickensoup commented on a change in pull request #7204: [AIRFLOW-XXXX] - add communication chapter to contributing

2020-01-22 Thread GitBox
mschickensoup commented on a change in pull request #7204: [AIRFLOW-] - add communication chapter to contributing URL: https://github.com/apache/airflow/pull/7204#discussion_r369121587 ## File path: CONTRIBUTING.rst ## @@ -664,6 +664,73 @@ Later on above depending

[GitHub] [airflow] mschickensoup commented on a change in pull request #7204: [AIRFLOW-XXXX] - add communication chapter to contributing

2020-01-22 Thread GitBox
mschickensoup commented on a change in pull request #7204: [AIRFLOW-] - add communication chapter to contributing URL: https://github.com/apache/airflow/pull/7204#discussion_r369503677 ## File path: CONTRIBUTING.rst ## @@ -664,6 +664,63 @@ Later on above depending

[GitHub] [airflow] mschickensoup commented on a change in pull request #7204: [AIRFLOW-XXXX] - add communication chapter to contributing

2020-01-22 Thread GitBox
mschickensoup commented on a change in pull request #7204: [AIRFLOW-] - add communication chapter to contributing URL: https://github.com/apache/airflow/pull/7204#discussion_r369505507 ## File path: CONTRIBUTING.rst ## @@ -664,6 +664,73 @@ Later on above depending

[GitHub] [airflow] mschickensoup commented on a change in pull request #7204: [AIRFLOW-XXXX] - add communication chapter to contributing

2020-01-22 Thread GitBox
mschickensoup commented on a change in pull request #7204: [AIRFLOW-] - add communication chapter to contributing URL: https://github.com/apache/airflow/pull/7204#discussion_r369639040 ## File path: CONTRIBUTING.rst ## @@ -664,6 +664,73 @@ Later on above depending

[GitHub] [airflow] mschickensoup commented on a change in pull request #7204: [AIRFLOW-XXXX] - add communication chapter to contributing

2020-01-22 Thread GitBox
mschickensoup commented on a change in pull request #7204: [AIRFLOW-] - add communication chapter to contributing URL: https://github.com/apache/airflow/pull/7204#discussion_r369636735 ## File path: CONTRIBUTING.rst ## @@ -664,6 +664,73 @@ Later on above depending

[GitHub] [airflow] mschickensoup commented on a change in pull request #7204: [AIRFLOW-XXXX] - add communication chapter to contributing

2020-01-22 Thread GitBox
mschickensoup commented on a change in pull request #7204: [AIRFLOW-] - add communication chapter to contributing URL: https://github.com/apache/airflow/pull/7204#discussion_r369500411 ## File path: CONTRIBUTING.rst ## @@ -664,6 +664,73 @@ Later on above depending

[GitHub] [airflow] mschickensoup commented on a change in pull request #7204: [AIRFLOW-XXXX] - add communication chapter to contributing

2020-01-22 Thread GitBox
mschickensoup commented on a change in pull request #7204: [AIRFLOW-] - add communication chapter to contributing URL: https://github.com/apache/airflow/pull/7204#discussion_r369503819 ## File path: CONTRIBUTING.rst ## @@ -664,6 +664,73 @@ Later on above depending

[GitHub] [airflow] mschickensoup commented on a change in pull request #7204: [AIRFLOW-XXXX] - add communication chapter to contributing

2020-01-22 Thread GitBox
mschickensoup commented on a change in pull request #7204: [AIRFLOW-] - add communication chapter to contributing URL: https://github.com/apache/airflow/pull/7204#discussion_r369122288 ## File path: CONTRIBUTING.rst ## @@ -664,6 +664,73 @@ Later on above depending

[GitHub] [airflow] mschickensoup commented on a change in pull request #7204: [AIRFLOW-XXXX] - add communication chapter to contributing

2020-01-22 Thread GitBox
mschickensoup commented on a change in pull request #7204: [AIRFLOW-] - add communication chapter to contributing URL: https://github.com/apache/airflow/pull/7204#discussion_r369636858 ## File path: CONTRIBUTING.rst ## @@ -664,6 +664,73 @@ Later on above depending

[GitHub] [airflow] mschickensoup commented on a change in pull request #7204: [AIRFLOW-XXXX] - add communication chapter to contributing

2020-01-22 Thread GitBox
mschickensoup commented on a change in pull request #7204: [AIRFLOW-] - add communication chapter to contributing URL: https://github.com/apache/airflow/pull/7204#discussion_r369505708 ## File path: CONTRIBUTING.rst ## @@ -664,6 +664,73 @@ Later on above depending

[GitHub] [airflow] mschickensoup commented on a change in pull request #7204: [AIRFLOW-XXXX] - add communication chapter to contributing

2020-01-22 Thread GitBox
mschickensoup commented on a change in pull request #7204: [AIRFLOW-] - add communication chapter to contributing URL: https://github.com/apache/airflow/pull/7204#discussion_r369638493 ## File path: CONTRIBUTING.rst ## @@ -664,6 +664,73 @@ Later on above depending

[GitHub] [airflow] mschickensoup commented on a change in pull request #7204: [AIRFLOW-XXXX] - add communication chapter to contributing

2020-01-22 Thread GitBox
mschickensoup commented on a change in pull request #7204: [AIRFLOW-] - add communication chapter to contributing URL: https://github.com/apache/airflow/pull/7204#discussion_r369636196 ## File path: CONTRIBUTING.rst ## @@ -664,6 +664,73 @@ Later on above depending

[GitHub] [airflow] mschickensoup commented on a change in pull request #7204: [AIRFLOW-XXXX] - add communication chapter to contributing

2020-01-22 Thread GitBox
mschickensoup commented on a change in pull request #7204: [AIRFLOW-] - add communication chapter to contributing URL: https://github.com/apache/airflow/pull/7204#discussion_r369635061 ## File path: CONTRIBUTING.rst ## @@ -664,6 +664,73 @@ Later on above depending

[jira] [Created] (AIRFLOW-6618) kubernetes_pod_operator no longer using kube context in provided config_file

2020-01-22 Thread Pat Carroll (Jira)
Pat Carroll created AIRFLOW-6618: Summary: kubernetes_pod_operator no longer using kube context in provided config_file Key: AIRFLOW-6618 URL: https://issues.apache.org/jira/browse/AIRFLOW-6618

[GitHub] [airflow] feluelle commented on a change in pull request #6824: [AIRFLOW-6258] add CloudFormation operators to AWS providers

2020-01-22 Thread GitBox
feluelle commented on a change in pull request #6824: [AIRFLOW-6258] add CloudFormation operators to AWS providers URL: https://github.com/apache/airflow/pull/6824#discussion_r369587843 ## File path: airflow/providers/amazon/aws/sensors/cloud_formation.py ## @@ -0,0 +1,98

[GitHub] [airflow] feluelle commented on a change in pull request #6824: [AIRFLOW-6258] add CloudFormation operators to AWS providers

2020-01-22 Thread GitBox
feluelle commented on a change in pull request #6824: [AIRFLOW-6258] add CloudFormation operators to AWS providers URL: https://github.com/apache/airflow/pull/6824#discussion_r369593236 ## File path: airflow/providers/amazon/aws/hooks/cloud_formation.py ## @@ -0,0 +1,88

[GitHub] [airflow] feluelle commented on a change in pull request #6824: [AIRFLOW-6258] add CloudFormation operators to AWS providers

2020-01-22 Thread GitBox
feluelle commented on a change in pull request #6824: [AIRFLOW-6258] add CloudFormation operators to AWS providers URL: https://github.com/apache/airflow/pull/6824#discussion_r369590507 ## File path: airflow/providers/amazon/aws/operators/cloud_formation.py ## @@ -0,0

[GitHub] [airflow] feluelle commented on a change in pull request #6824: [AIRFLOW-6258] add CloudFormation operators to AWS providers

2020-01-22 Thread GitBox
feluelle commented on a change in pull request #6824: [AIRFLOW-6258] add CloudFormation operators to AWS providers URL: https://github.com/apache/airflow/pull/6824#discussion_r369587280 ## File path: airflow/providers/amazon/aws/operators/cloud_formation.py ## @@ -0,0

[GitHub] [airflow] feluelle commented on a change in pull request #6824: [AIRFLOW-6258] add CloudFormation operators to AWS providers

2020-01-22 Thread GitBox
feluelle commented on a change in pull request #6824: [AIRFLOW-6258] add CloudFormation operators to AWS providers URL: https://github.com/apache/airflow/pull/6824#discussion_r369586964 ## File path: airflow/providers/amazon/aws/operators/cloud_formation.py ## @@ -0,0

[GitHub] [airflow] feluelle commented on a change in pull request #6824: [AIRFLOW-6258] add CloudFormation operators to AWS providers

2020-01-22 Thread GitBox
feluelle commented on a change in pull request #6824: [AIRFLOW-6258] add CloudFormation operators to AWS providers URL: https://github.com/apache/airflow/pull/6824#discussion_r369590133 ## File path: airflow/providers/amazon/aws/operators/cloud_formation.py ## @@ -0,0

[GitHub] [airflow] feluelle commented on a change in pull request #6824: [AIRFLOW-6258] add CloudFormation operators to AWS providers

2020-01-22 Thread GitBox
feluelle commented on a change in pull request #6824: [AIRFLOW-6258] add CloudFormation operators to AWS providers URL: https://github.com/apache/airflow/pull/6824#discussion_r369589043 ## File path: airflow/providers/amazon/aws/sensors/cloud_formation.py ## @@ -0,0 +1,98

[jira] [Assigned] (AIRFLOW-6551) KubernetesExecutor does not create dynamic pods for tasks inside subdag

2020-01-22 Thread Hamid Mahmood (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6551?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hamid Mahmood reassigned AIRFLOW-6551: -- Assignee: (was: Daniel Imberman) > KubernetesExecutor does not create dynamic

[jira] [Commented] (AIRFLOW-6617) Add tests to PYTHONPATH in breeze

2020-01-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6617?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17021035#comment-17021035 ] ASF GitHub Bot commented on AIRFLOW-6617: - nuclearpinguin commented on pull request #7241:

[GitHub] [airflow] nuclearpinguin opened a new pull request #7241: [AIRFLOW-6617] Add tests to PYTHONPATH in breeze

2020-01-22 Thread GitBox
nuclearpinguin opened a new pull request #7241: [AIRFLOW-6617] Add tests to PYTHONPATH in breeze URL: https://github.com/apache/airflow/pull/7241 Adding tests directory to PYTHONPATH helps during development :) --- Issue link: WILL BE INSERTED BY

[jira] [Created] (AIRFLOW-6617) Add tests to PYTHONPATH in breeze

2020-01-22 Thread Tomasz Urbaszek (Jira)
Tomasz Urbaszek created AIRFLOW-6617: Summary: Add tests to PYTHONPATH in breeze Key: AIRFLOW-6617 URL: https://issues.apache.org/jira/browse/AIRFLOW-6617 Project: Apache Airflow Issue

[jira] [Commented] (AIRFLOW-4495) allow externally triggered dags to run for future 'Execution date'

2020-01-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-4495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17021007#comment-17021007 ] ASF GitHub Bot commented on AIRFLOW-4495: - kaxil commented on pull request #7038:

[jira] [Commented] (AIRFLOW-4495) allow externally triggered dags to run for future 'Execution date'

2020-01-22 Thread ASF subversion and git services (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-4495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17021008#comment-17021008 ] ASF subversion and git services commented on AIRFLOW-4495: -- Commit

[jira] [Resolved] (AIRFLOW-4495) allow externally triggered dags to run for future 'Execution date'

2020-01-22 Thread Kaxil Naik (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-4495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kaxil Naik resolved AIRFLOW-4495. - Fix Version/s: 1.10.8 2.0.0 Resolution: Fixed > allow externally

[GitHub] [airflow] kaxil merged pull request #7038: [AIRFLOW-4495] Allow externally triggered dags to run for future exec dates

2020-01-22 Thread GitBox
kaxil merged pull request #7038: [AIRFLOW-4495] Allow externally triggered dags to run for future exec dates URL: https://github.com/apache/airflow/pull/7038 This is an automated message from the Apache Git Service. To

[GitHub] [airflow] tooptoop4 removed a comment on issue #6954: [AIRFLOW-4355] removed task should not lead to dagrun success

2020-01-22 Thread GitBox
tooptoop4 removed a comment on issue #6954: [AIRFLOW-4355] removed task should not lead to dagrun success URL: https://github.com/apache/airflow/pull/6954#issuecomment-572718287 @ashb pls merge This is an automated message

[GitHub] [airflow] tooptoop4 commented on issue #7038: [AIRFLOW-4495] Allow externally triggered dags to run for future exec dates

2020-01-22 Thread GitBox
tooptoop4 commented on issue #7038: [AIRFLOW-4495] Allow externally triggered dags to run for future exec dates URL: https://github.com/apache/airflow/pull/7038#issuecomment-577157255 @kaxil pls merge :) This is an automated

[GitHub] [airflow] codecov-io commented on issue #7227: [AIRFLOW-6539] Allow Custom Statsd Client

2020-01-22 Thread GitBox
codecov-io commented on issue #7227: [AIRFLOW-6539] Allow Custom Statsd Client URL: https://github.com/apache/airflow/pull/7227#issuecomment-577151472 # [Codecov](https://codecov.io/gh/apache/airflow/pull/7227?src=pr=h1) Report > Merging

[jira] [Updated] (AIRFLOW-6583) (BigQuery) Add query_params to templated_fields

2020-01-22 Thread Jithin Sukumar (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6583?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jithin Sukumar updated AIRFLOW-6583: Description: To query time-partitioned tables, I am passing {{query_params}} like this

[GitHub] [airflow] roitvt commented on issue #7163: [AIRFLOW-6542] add spark-on-k8s operator/hook/sensor

2020-01-22 Thread GitBox
roitvt commented on issue #7163: [AIRFLOW-6542] add spark-on-k8s operator/hook/sensor URL: https://github.com/apache/airflow/pull/7163#issuecomment-577146596 ping @mik-laj This is an automated message from the Apache Git

[GitHub] [airflow] aviemzur commented on issue #6824: [AIRFLOW-6258] add CloudFormation operators to AWS providers

2020-01-22 Thread GitBox
aviemzur commented on issue #6824: [AIRFLOW-6258] add CloudFormation operators to AWS providers URL: https://github.com/apache/airflow/pull/6824#issuecomment-577144219 @nuclearpinguin made the changes you requested: [Changes after CR

[GitHub] [airflow] codecov-io edited a comment on issue #7038: [AIRFLOW-4495] Allow externally triggered dags to run for future exec dates

2020-01-22 Thread GitBox
codecov-io edited a comment on issue #7038: [AIRFLOW-4495] Allow externally triggered dags to run for future exec dates URL: https://github.com/apache/airflow/pull/7038#issuecomment-570935774 # [Codecov](https://codecov.io/gh/apache/airflow/pull/7038?src=pr=h1) Report > :exclamation:

[GitHub] [airflow] codecov-io edited a comment on issue #7038: [AIRFLOW-4495] Allow externally triggered dags to run for future exec dates

2020-01-22 Thread GitBox
codecov-io edited a comment on issue #7038: [AIRFLOW-4495] Allow externally triggered dags to run for future exec dates URL: https://github.com/apache/airflow/pull/7038#issuecomment-570935774 # [Codecov](https://codecov.io/gh/apache/airflow/pull/7038?src=pr=h1) Report > :exclamation:

[GitHub] [airflow] codecov-io edited a comment on issue #6457: [AIRFLOW-5800] Add a default connection entry for PinotDbApiHook

2020-01-22 Thread GitBox
codecov-io edited a comment on issue #6457: [AIRFLOW-5800] Add a default connection entry for PinotDbApiHook URL: https://github.com/apache/airflow/pull/6457#issuecomment-552073991 # [Codecov](https://codecov.io/gh/apache/airflow/pull/6457?src=pr=h1) Report > Merging

[GitHub] [airflow] codecov-io edited a comment on issue #6457: [AIRFLOW-5800] Add a default connection entry for PinotDbApiHook

2020-01-22 Thread GitBox
codecov-io edited a comment on issue #6457: [AIRFLOW-5800] Add a default connection entry for PinotDbApiHook URL: https://github.com/apache/airflow/pull/6457#issuecomment-552073991 # [Codecov](https://codecov.io/gh/apache/airflow/pull/6457?src=pr=h1) Report > Merging

[GitHub] [airflow] kaxil edited a comment on issue #7139: [AIRFLOW-2279] Clear tasks across DAGs if marked by ExternalTaskMarker

2020-01-22 Thread GitBox
kaxil edited a comment on issue #7139: [AIRFLOW-2279] Clear tasks across DAGs if marked by ExternalTaskMarker URL: https://github.com/apache/airflow/pull/7139#issuecomment-577136743 The tests are unstable on v1-10-test branch. We are fixing it, will keep you updated. Thanks for

[GitHub] [airflow] kaxil commented on issue #7139: [AIRFLOW-2279] Clear tasks across DAGs if marked by ExternalTaskMarker

2020-01-22 Thread GitBox
kaxil commented on issue #7139: [AIRFLOW-2279] Clear tasks across DAGs if marked by ExternalTaskMarker URL: https://github.com/apache/airflow/pull/7139#issuecomment-577136743 The tests are unstable on v1-10-test branch. We are fixing it. Thanks for this backport PR @yuqian90  ,

[GitHub] [airflow] nuclearpinguin commented on issue #7038: [AIRFLOW-4495] allow externally triggered dags to run for future exec dates

2020-01-22 Thread GitBox
nuclearpinguin commented on issue #7038: [AIRFLOW-4495] allow externally triggered dags to run for future exec dates URL: https://github.com/apache/airflow/pull/7038#issuecomment-577133637 > The test failures in Travis are in seemingly unrelated tests such as testviews.py. it's very

[GitHub] [airflow] nuclearpinguin commented on a change in pull request #7213: [AIRFLOW-6424] Added a operator to modify EMR cluster

2020-01-22 Thread GitBox
nuclearpinguin commented on a change in pull request #7213: [AIRFLOW-6424] Added a operator to modify EMR cluster URL: https://github.com/apache/airflow/pull/7213#discussion_r369500126 ## File path: airflow/providers/amazon/aws/operators/emr_modify_cluster.py ## @@ -0,0

[GitHub] [airflow] nuclearpinguin commented on issue #7230: [AIRFLOW-6602]: render executor_config before triggering tasks to su…

2020-01-22 Thread GitBox
nuclearpinguin commented on issue #7230: [AIRFLOW-6602]: render executor_config before triggering tasks to su… URL: https://github.com/apache/airflow/pull/7230#issuecomment-577130919 Travis is sad, can you fix pylint errors?

[GitHub] [airflow] kaxil commented on a change in pull request #6900: [AIRFLOW-6346] Enhance dag default_view and orientation

2020-01-22 Thread GitBox
kaxil commented on a change in pull request #6900: [AIRFLOW-6346] Enhance dag default_view and orientation URL: https://github.com/apache/airflow/pull/6900#discussion_r369496408 ## File path: airflow/models/dag.py ## @@ -296,8 +298,16 @@ def __init__(

[jira] [Created] (AIRFLOW-6616) Add Tableau Hook and Operators

2020-01-22 Thread Rok Mihevc (Jira)
Rok Mihevc created AIRFLOW-6616: --- Summary: Add Tableau Hook and Operators Key: AIRFLOW-6616 URL: https://issues.apache.org/jira/browse/AIRFLOW-6616 Project: Apache Airflow Issue Type: New

[GitHub] [airflow] kaxil commented on issue #6457: [AIRFLOW-5800] Add a default connection entry for PinotDbApiHook

2020-01-22 Thread GitBox
kaxil commented on issue #6457: [AIRFLOW-5800] Add a default connection entry for PinotDbApiHook URL: https://github.com/apache/airflow/pull/6457#issuecomment-577125000 I have resolved the merge conflict, waiting for the CI before I merge. Although @sekikn can you add a test to

[GitHub] [airflow] kaxil commented on issue #6457: [AIRFLOW-5800] Add a default connection entry for PinotDbApiHook

2020-01-22 Thread GitBox
kaxil commented on issue #6457: [AIRFLOW-5800] Add a default connection entry for PinotDbApiHook URL: https://github.com/apache/airflow/pull/6457#issuecomment-577120725 > https://github.com/apache/airflow/blob/master/airflow/providers/apache/pinot/hooks/pinot.py#L217 It is actually

[GitHub] [airflow] kaxil commented on a change in pull request #2460: [AIRFLOW-1424] make the next execution date of DAGs visible

2020-01-22 Thread GitBox
kaxil commented on a change in pull request #2460: [AIRFLOW-1424] make the next execution date of DAGs visible URL: https://github.com/apache/airflow/pull/2460#discussion_r369484249 ## File path: airflow/jobs.py ## @@ -892,6 +891,11 @@ def create_dag_run(self, dag,

[GitHub] [airflow] kaxil edited a comment on issue #5308: [AIRFLOW-4549] skipped tasks should be ok for wait_for_downstream

2020-01-22 Thread GitBox
kaxil edited a comment on issue #5308: [AIRFLOW-4549] skipped tasks should be ok for wait_for_downstream URL: https://github.com/apache/airflow/pull/5308#issuecomment-577115221 I have resolved the conflicts @potiuk and @TeddyHartanto . I think we can merge it as it is. Already has

[GitHub] [airflow] kaxil edited a comment on issue #5308: [AIRFLOW-4549] skipped tasks should be ok for wait_for_downstream

2020-01-22 Thread GitBox
kaxil edited a comment on issue #5308: [AIRFLOW-4549] skipped tasks should be ok for wait_for_downstream URL: https://github.com/apache/airflow/pull/5308#issuecomment-577115221 I have resolved the conflicts @potiuk and @TeddyHartanto . I think we can merge it as it is. Already has

[GitHub] [airflow] kaxil commented on issue #5308: [AIRFLOW-4549] skipped tasks should be ok for wait_for_downstream

2020-01-22 Thread GitBox
kaxil commented on issue #5308: [AIRFLOW-4549] skipped tasks should be ok for wait_for_downstream URL: https://github.com/apache/airflow/pull/5308#issuecomment-577115221 I have resolved the conflicts @potiuk and @TeddyHartanto . I think we can merge it as it is. Already has an

[GitHub] [airflow] yuqian90 commented on a change in pull request #7143: [AIRFLOW-6527] Make send_task_to_executor timeout configurable

2020-01-22 Thread GitBox
yuqian90 commented on a change in pull request #7143: [AIRFLOW-6527] Make send_task_to_executor timeout configurable URL: https://github.com/apache/airflow/pull/7143#discussion_r369478045 ## File path: airflow/config_templates/default_airflow.cfg ## @@ -537,6 +537,9 @@

[GitHub] [airflow] kaxil commented on a change in pull request #5970: [AIRFLOW-2923][AIRFLOW-1784] Implement LatestOnlyOperator as BaseBranchOperator

2020-01-22 Thread GitBox
kaxil commented on a change in pull request #5970: [AIRFLOW-2923][AIRFLOW-1784] Implement LatestOnlyOperator as BaseBranchOperator URL: https://github.com/apache/airflow/pull/5970#discussion_r369471993 ## File path: docs/concepts.rst ## @@ -1078,15 +1078,14 @@ For

[GitHub] [airflow] kaxil commented on a change in pull request #7143: [AIRFLOW-6527] Make send_task_to_executor timeout configurable

2020-01-22 Thread GitBox
kaxil commented on a change in pull request #7143: [AIRFLOW-6527] Make send_task_to_executor timeout configurable URL: https://github.com/apache/airflow/pull/7143#discussion_r369470733 ## File path: airflow/config_templates/default_airflow.cfg ## @@ -537,6 +537,9 @@

  1   2   >