[jira] [Commented] (AIRFLOW-6038) AWS DataSync example dags

2019-12-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16992513#comment-16992513 ] ASF GitHub Bot commented on AIRFLOW-6038: - baolsen commented on pull request #6773:

[GitHub] [airflow] baolsen opened a new pull request #6773: [AIRFLOW-6038] AWS DataSync example_dags added

2019-12-10 Thread GitBox
baolsen opened a new pull request #6773: [AIRFLOW-6038] AWS DataSync example_dags added URL: https://github.com/apache/airflow/pull/6773 Make sure you have checked _all_ steps below. Re-open of #6675 ### Jira - [X] My PR addresses the following [Airflow

[GitHub] [airflow] baolsen commented on issue #6675: [AIRFLOW-6038] AWS DataSync example_dags added

2019-12-10 Thread GitBox
baolsen commented on issue #6675: [AIRFLOW-6038] AWS DataSync example_dags added URL: https://github.com/apache/airflow/pull/6675#issuecomment-564016135 Re-opened as https://github.com/apache/airflow/pull/6773 This is

[GitHub] [airflow] codecov-io edited a comment on issue #6770: [AIRFLOW-6216] Allow pytests to be run without "tests"

2019-12-10 Thread GitBox
codecov-io edited a comment on issue #6770: [AIRFLOW-6216] Allow pytests to be run without "tests" URL: https://github.com/apache/airflow/pull/6770#issuecomment-564028706 # [Codecov](https://codecov.io/gh/apache/airflow/pull/6770?src=pr=h1) Report > :exclamation: No coverage uploaded

[GitHub] [airflow] codecov-io commented on issue #6770: [AIRFLOW-6216] Allow pytests to be run without "tests"

2019-12-10 Thread GitBox
codecov-io commented on issue #6770: [AIRFLOW-6216] Allow pytests to be run without "tests" URL: https://github.com/apache/airflow/pull/6770#issuecomment-564028706 # [Codecov](https://codecov.io/gh/apache/airflow/pull/6770?src=pr=h1) Report > :exclamation: No coverage uploaded for pull

[jira] [Created] (AIRFLOW-6217) KubernetesPodOperator XCom pushes not working

2019-12-10 Thread Eugene Serdyuk (Jira)
Eugene Serdyuk created AIRFLOW-6217: --- Summary: KubernetesPodOperator XCom pushes not working Key: AIRFLOW-6217 URL: https://issues.apache.org/jira/browse/AIRFLOW-6217 Project: Apache Airflow

[jira] [Commented] (AIRFLOW-3014) Password column on connection table should be longer

2019-12-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-3014?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16992537#comment-16992537 ] ASF GitHub Bot commented on AIRFLOW-3014: - ashb commented on pull request #6241: [AIRFLOW-3014]

[jira] [Resolved] (AIRFLOW-3014) Password column on connection table should be longer

2019-12-10 Thread Ash Berlin-Taylor (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-3014?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ash Berlin-Taylor resolved AIRFLOW-3014. Fix Version/s: 1.10.7 Resolution: Fixed > Password column on connection

[jira] [Commented] (AIRFLOW-3014) Password column on connection table should be longer

2019-12-10 Thread ASF subversion and git services (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-3014?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16992539#comment-16992539 ] ASF subversion and git services commented on AIRFLOW-3014: -- Commit

[jira] [Commented] (AIRFLOW-6168) Make ProxyFix arguments configurable for non-standard reverse proxies

2019-12-10 Thread ASF subversion and git services (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6168?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16992583#comment-16992583 ] ASF subversion and git services commented on AIRFLOW-6168: -- Commit

[jira] [Commented] (AIRFLOW-6168) Make ProxyFix arguments configurable for non-standard reverse proxies

2019-12-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6168?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16992582#comment-16992582 ] ASF GitHub Bot commented on AIRFLOW-6168: - ashb commented on pull request #6723: [AIRFLOW-6168]

[jira] [Resolved] (AIRFLOW-6168) Make ProxyFix arguments configurable for non-standard reverse proxies

2019-12-10 Thread Ash Berlin-Taylor (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ash Berlin-Taylor resolved AIRFLOW-6168. Fix Version/s: 1.10.7 Resolution: Fixed > Make ProxyFix arguments

[jira] [Created] (AIRFLOW-6218) PapermillOperator has no functional Jinja support

2019-12-10 Thread Michiel Ghyselinck (Jira)
Michiel Ghyselinck created AIRFLOW-6218: --- Summary: PapermillOperator has no functional Jinja support Key: AIRFLOW-6218 URL: https://issues.apache.org/jira/browse/AIRFLOW-6218 Project: Apache

[GitHub] [airflow] mik-laj commented on issue #6764: [AIRFLOW-6206] Use "aws_" prefix for aws_batch_operator.py module

2019-12-10 Thread GitBox
mik-laj commented on issue #6764: [AIRFLOW-6206] Use "aws_" prefix for aws_batch_operator.py module URL: https://github.com/apache/airflow/pull/6764#issuecomment-563936011 This is not just a module change, but your implementation is not backwards compatible, which can cause a problem for

[GitHub] [airflow] OmerJog commented on issue #5785: [AIRFLOW-5176] Add Azure Data Explorer (Kusto) operator

2019-12-10 Thread GitBox
OmerJog commented on issue #5785: [AIRFLOW-5176] Add Azure Data Explorer (Kusto) operator URL: https://github.com/apache/airflow/pull/5785#issuecomment-563947945 @potiuk can you please verify what path this operator should be according to AIP-21? `airflow/provides/azure `?

[GitHub] [airflow] ashb commented on a change in pull request #6660: [AIRFLOW-6065] Add Stackdriver Task Handler

2019-12-10 Thread GitBox
ashb commented on a change in pull request #6660: [AIRFLOW-6065] Add Stackdriver Task Handler URL: https://github.com/apache/airflow/pull/6660#discussion_r355963514 ## File path: docs/howto/write-logs.rst ## @@ -36,6 +36,38 @@ can not be found or accessed, local logs will

[jira] [Commented] (AIRFLOW-5931) Spawning new python interpreter for every task slow

2019-12-10 Thread Felix Uellendall (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5931?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16992434#comment-16992434 ] Felix Uellendall commented on AIRFLOW-5931: --- [~ash] don't forget to resolve the issue :)

[jira] [Commented] (AIRFLOW-6175) Executor changes queued tasks to scheduled without removing from task queue

2019-12-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6175?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16992452#comment-16992452 ] ASF GitHub Bot commented on AIRFLOW-6175: - ashb commented on pull request #6732: [AIRFLOW-6175]

[GitHub] [airflow] ashb merged pull request #6732: [AIRFLOW-6175] fixes scheduler queue bug

2019-12-10 Thread GitBox
ashb merged pull request #6732: [AIRFLOW-6175] fixes scheduler queue bug URL: https://github.com/apache/airflow/pull/6732 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[jira] [Commented] (AIRFLOW-6175) Executor changes queued tasks to scheduled without removing from task queue

2019-12-10 Thread ASF subversion and git services (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6175?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16992453#comment-16992453 ] ASF subversion and git services commented on AIRFLOW-6175: -- Commit

[GitHub] [airflow] codecov-io edited a comment on issue #5785: [AIRFLOW-5176] Add Azure Data Explorer (Kusto) operator

2019-12-10 Thread GitBox
codecov-io edited a comment on issue #5785: [AIRFLOW-5176] Add Azure Data Explorer (Kusto) operator URL: https://github.com/apache/airflow/pull/5785#issuecomment-553413704 # [Codecov](https://codecov.io/gh/apache/airflow/pull/5785?src=pr=h1) Report > Merging

[GitHub] [airflow] ashb commented on a change in pull request #6230: [AIRFLOW-5413] Allow K8S worker pod to be configured from JSON/YAML file

2019-12-10 Thread GitBox
ashb commented on a change in pull request #6230: [AIRFLOW-5413] Allow K8S worker pod to be configured from JSON/YAML file URL: https://github.com/apache/airflow/pull/6230#discussion_r355989214 ## File path: airflow/executors/kubernetes_executor.py ## @@ -402,22 +405,30

[GitHub] [airflow] ashb commented on a change in pull request #6230: [AIRFLOW-5413] Allow K8S worker pod to be configured from JSON/YAML file

2019-12-10 Thread GitBox
ashb commented on a change in pull request #6230: [AIRFLOW-5413] Allow K8S worker pod to be configured from JSON/YAML file URL: https://github.com/apache/airflow/pull/6230#discussion_r355989741 ## File path: airflow/kubernetes/pod_generator.py ## @@ -60,74 +71,118 @@

[GitHub] [airflow] ashb commented on a change in pull request #6230: [AIRFLOW-5413] Allow K8S worker pod to be configured from JSON/YAML file

2019-12-10 Thread GitBox
ashb commented on a change in pull request #6230: [AIRFLOW-5413] Allow K8S worker pod to be configured from JSON/YAML file URL: https://github.com/apache/airflow/pull/6230#discussion_r355993872 ## File path: airflow/kubernetes/pod_generator.py ## @@ -298,51 +361,171 @@

[GitHub] [airflow] kaxil commented on issue #6772: [AIRFLOW-XXX] Update airflow-jira release management script

2019-12-10 Thread GitBox
kaxil commented on issue #6772: [AIRFLOW-XXX] Update airflow-jira release management script URL: https://github.com/apache/airflow/pull/6772#issuecomment-564002446 Can you update https://github.com/apache/airflow/blob/master/dev/README.md too, please?

[GitHub] [airflow] ashb commented on a change in pull request #6230: [AIRFLOW-5413] Allow K8S worker pod to be configured from JSON/YAML file

2019-12-10 Thread GitBox
ashb commented on a change in pull request #6230: [AIRFLOW-5413] Allow K8S worker pod to be configured from JSON/YAML file URL: https://github.com/apache/airflow/pull/6230#discussion_r356003250 ## File path: airflow/kubernetes/pod_generator.py ## @@ -298,51 +361,171 @@

[GitHub] [airflow] codecov-io edited a comment on issue #6769: [AIRFLOW-6215] BigQuery - use unittest assertions in hooks tests

2019-12-10 Thread GitBox
codecov-io edited a comment on issue #6769: [AIRFLOW-6215] BigQuery - use unittest assertions in hooks tests URL: https://github.com/apache/airflow/pull/6769#issuecomment-564016710 # [Codecov](https://codecov.io/gh/apache/airflow/pull/6769?src=pr=h1) Report > Merging

[GitHub] [airflow] codecov-io commented on issue #6769: [AIRFLOW-6215] BigQuery - use unittest assertions in hooks tests

2019-12-10 Thread GitBox
codecov-io commented on issue #6769: [AIRFLOW-6215] BigQuery - use unittest assertions in hooks tests URL: https://github.com/apache/airflow/pull/6769#issuecomment-564016710 # [Codecov](https://codecov.io/gh/apache/airflow/pull/6769?src=pr=h1) Report > Merging

[jira] [Commented] (AIRFLOW-3794) Decommission modules in `airflow/contrib/auth/backends/`, other than `password_auth`

2019-12-10 Thread jack (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-3794?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16992514#comment-16992514 ] jack commented on AIRFLOW-3794: ---  Do we need this? conrtib should be removed following to AIP 21 >

[jira] [Resolved] (AIRFLOW-6175) Executor changes queued tasks to scheduled without removing from task queue

2019-12-10 Thread Ash Berlin-Taylor (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6175?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ash Berlin-Taylor resolved AIRFLOW-6175. Fix Version/s: (was: 1.10.6) 1.10.7 Resolution:

[jira] [Commented] (AIRFLOW-6058) Run tests with pytest

2019-12-10 Thread ASF subversion and git services (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6058?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16992568#comment-16992568 ] ASF subversion and git services commented on AIRFLOW-6058: -- Commit

[jira] [Commented] (AIRFLOW-6216) Allow pytests to be run without "tests"

2019-12-10 Thread ASF subversion and git services (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6216?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16992569#comment-16992569 ] ASF subversion and git services commented on AIRFLOW-6216: -- Commit

[GitHub] [airflow] ashb merged pull request #6723: [AIRFLOW-6168] allows proxyfix to be configurable

2019-12-10 Thread GitBox
ashb merged pull request #6723: [AIRFLOW-6168] allows proxyfix to be configurable URL: https://github.com/apache/airflow/pull/6723 This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [airflow] potiuk commented on issue #6769: [AIRFLOW-6215] BigQuery - use unittest assertions in hooks tests

2019-12-10 Thread GitBox
potiuk commented on issue #6769: [AIRFLOW-6215] BigQuery - use unittest assertions in hooks tests URL: https://github.com/apache/airflow/pull/6769#issuecomment-564023465 I think it's a universal consensus that standard asserts are good in tests :) -> we should remove them from the

[GitHub] [airflow] potiuk commented on issue #6769: [AIRFLOW-6215] BigQuery - use unittest assertions in hooks tests

2019-12-10 Thread GitBox
potiuk commented on issue #6769: [AIRFLOW-6215] BigQuery - use unittest assertions in hooks tests URL: https://github.com/apache/airflow/pull/6769#issuecomment-564023557 Vide "Revenge of the asserts" thread at the devlist :).

[GitHub] [airflow] ashb commented on a change in pull request #6340: [AIRFLOW-5660] Attempt to find the task in DB from Kubernetes pod labels

2019-12-10 Thread GitBox
ashb commented on a change in pull request #6340: [AIRFLOW-5660] Attempt to find the task in DB from Kubernetes pod labels URL: https://github.com/apache/airflow/pull/6340#discussion_r356030450 ## File path: airflow/executors/kubernetes_executor.py ## @@ -545,6 +545,27 @@

[jira] [Resolved] (AIRFLOW-5931) Spawning new python interpreter for every task slow

2019-12-10 Thread Ash Berlin-Taylor (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5931?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ash Berlin-Taylor resolved AIRFLOW-5931. Fix Version/s: 1.10.7 Resolution: Fixed > Spawning new python interpreter

[GitHub] [airflow] ashb merged pull request #6241: [AIRFLOW-3014] Increase connection password length to match model

2019-12-10 Thread GitBox
ashb merged pull request #6241: [AIRFLOW-3014] Increase connection password length to match model URL: https://github.com/apache/airflow/pull/6241 This is an automated message from the Apache Git Service. To respond to the

[jira] [Commented] (AIRFLOW-6056) Allow EmrAddStepsOperator to accept job_flow_name as alternative to job_flow_id

2019-12-10 Thread ASF subversion and git services (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16992554#comment-16992554 ] ASF subversion and git services commented on AIRFLOW-6056: -- Commit

[GitHub] [airflow] potiuk merged pull request #6770: [AIRFLOW-6216] Allow pytests to be run without "tests"

2019-12-10 Thread GitBox
potiuk merged pull request #6770: [AIRFLOW-6216] Allow pytests to be run without "tests" URL: https://github.com/apache/airflow/pull/6770 This is an automated message from the Apache Git Service. To respond to the message,

[jira] [Commented] (AIRFLOW-6216) Allow pytests to be run without "tests"

2019-12-10 Thread ASF subversion and git services (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6216?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16992552#comment-16992552 ] ASF subversion and git services commented on AIRFLOW-6216: -- Commit

[jira] [Commented] (AIRFLOW-6216) Allow pytests to be run without "tests"

2019-12-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6216?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16992551#comment-16992551 ] ASF GitHub Bot commented on AIRFLOW-6216: - potiuk commented on pull request #6770:

[jira] [Resolved] (AIRFLOW-6056) Allow EmrAddStepsOperator to accept job_flow_name as alternative to job_flow_id

2019-12-10 Thread Ash Berlin-Taylor (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ash Berlin-Taylor resolved AIRFLOW-6056. Fix Version/s: 1.10.7 Resolution: Fixed > Allow EmrAddStepsOperator to

[jira] [Commented] (AIRFLOW-6056) Allow EmrAddStepsOperator to accept job_flow_name as alternative to job_flow_id

2019-12-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16992553#comment-16992553 ] ASF GitHub Bot commented on AIRFLOW-6056: - ashb commented on pull request #6655: [AIRFLOW-6056]

[GitHub] [airflow] ashb merged pull request #6655: [AIRFLOW-6056] Allow EmrAddStepsOperator to accept job_flow_name as alternative to job_flow_id

2019-12-10 Thread GitBox
ashb merged pull request #6655: [AIRFLOW-6056] Allow EmrAddStepsOperator to accept job_flow_name as alternative to job_flow_id URL: https://github.com/apache/airflow/pull/6655 This is an automated message from the Apache

[jira] [Created] (AIRFLOW-6215) BigQuery - use unittest assertions in hooks tests

2019-12-10 Thread Tobiasz Kedzierski (Jira)
Tobiasz Kedzierski created AIRFLOW-6215: --- Summary: BigQuery - use unittest assertions in hooks tests Key: AIRFLOW-6215 URL: https://issues.apache.org/jira/browse/AIRFLOW-6215 Project: Apache

[jira] [Commented] (AIRFLOW-6058) Run tests with pytest

2019-12-10 Thread ASF subversion and git services (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6058?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16992365#comment-16992365 ] ASF subversion and git services commented on AIRFLOW-6058: -- Commit

[jira] [Commented] (AIRFLOW-6018) Display task instance in table during backfilling

2019-12-10 Thread ASF subversion and git services (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6018?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16992369#comment-16992369 ] ASF subversion and git services commented on AIRFLOW-6018: -- Commit

[jira] [Commented] (AIRFLOW-6191) Adjust pytest verbosity in CI and local environment

2019-12-10 Thread ASF subversion and git services (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16992371#comment-16992371 ] ASF subversion and git services commented on AIRFLOW-6191: -- Commit

[jira] [Commented] (AIRFLOW-6018) Display task instance in table during backfilling

2019-12-10 Thread ASF subversion and git services (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6018?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16992370#comment-16992370 ] ASF subversion and git services commented on AIRFLOW-6018: -- Commit

[jira] [Commented] (AIRFLOW-6180) Improve kerberos init in pytest conftest

2019-12-10 Thread ASF subversion and git services (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16992366#comment-16992366 ] ASF subversion and git services commented on AIRFLOW-6180: -- Commit

[jira] [Commented] (AIRFLOW-6189) Reduce the maximum test duration to 8 minutes

2019-12-10 Thread ASF subversion and git services (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6189?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16992368#comment-16992368 ] ASF subversion and git services commented on AIRFLOW-6189: -- Commit

[jira] [Commented] (AIRFLOW-6177) Log DAG processors timeout event at error level, not info

2019-12-10 Thread ASF subversion and git services (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16992367#comment-16992367 ] ASF subversion and git services commented on AIRFLOW-6177: -- Commit

[GitHub] [airflow] ashb commented on a change in pull request #6660: [AIRFLOW-6065] Add Stackdriver Task Handler

2019-12-10 Thread GitBox
ashb commented on a change in pull request #6660: [AIRFLOW-6065] Add Stackdriver Task Handler URL: https://github.com/apache/airflow/pull/6660#discussion_r355965513 ## File path: docs/howto/write-logs.rst ## @@ -36,6 +36,38 @@ can not be found or accessed, local logs will

[GitHub] [airflow] ashb commented on a change in pull request #6660: [AIRFLOW-6065] Add Stackdriver Task Handler

2019-12-10 Thread GitBox
ashb commented on a change in pull request #6660: [AIRFLOW-6065] Add Stackdriver Task Handler URL: https://github.com/apache/airflow/pull/6660#discussion_r355965389 ## File path: docs/howto/write-logs.rst ## @@ -36,6 +36,38 @@ can not be found or accessed, local logs will

[jira] [Updated] (AIRFLOW-6216) Allow pytests to be run without "tests"

2019-12-10 Thread Jarek Potiuk (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6216?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jarek Potiuk updated AIRFLOW-6216: -- Description: With this change you should be able to simply run `pyttest` to run all the

[jira] [Updated] (AIRFLOW-6216) Allow pytests to be run without "tests"

2019-12-10 Thread Jarek Potiuk (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6216?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jarek Potiuk updated AIRFLOW-6216: -- Description: With this change you should be able to simply run `pytest` to run all the tests

[GitHub] [airflow] ashb merged pull request #6627: [AIRFLOW-5931] Use os.fork when appropriate to speed up task execution.

2019-12-10 Thread GitBox
ashb merged pull request #6627: [AIRFLOW-5931] Use os.fork when appropriate to speed up task execution. URL: https://github.com/apache/airflow/pull/6627 This is an automated message from the Apache Git Service. To respond

[GitHub] [airflow] potiuk opened a new pull request #6770: [AIRFLOW-6216] Allow pytests to be run without "tests"

2019-12-10 Thread GitBox
potiuk opened a new pull request #6770: [AIRFLOW-6216] Allow pytests to be run without "tests" URL: https://github.com/apache/airflow/pull/6770 With this change you should be able to simply run `pytest` to run all the tests in the main airflow directory. This consist of two

[jira] [Commented] (AIRFLOW-6216) Allow pytests to be run without "tests"

2019-12-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6216?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16992426#comment-16992426 ] ASF GitHub Bot commented on AIRFLOW-6216: - potiuk commented on pull request #6770:

[GitHub] [airflow] potiuk commented on issue #6770: [AIRFLOW-6216] Allow pytests to be run without "tests"

2019-12-10 Thread GitBox
potiuk commented on issue #6770: [AIRFLOW-6216] Allow pytests to be run without "tests" URL: https://github.com/apache/airflow/pull/6770#issuecomment-563979718 @nuclearpinguin -> small improvement in pytest config. This is

[GitHub] [airflow] ashb commented on a change in pull request #6230: [AIRFLOW-5413] Allow K8S worker pod to be configured from JSON/YAML file

2019-12-10 Thread GitBox
ashb commented on a change in pull request #6230: [AIRFLOW-5413] Allow K8S worker pod to be configured from JSON/YAML file URL: https://github.com/apache/airflow/pull/6230#discussion_r355989662 ## File path: airflow/kubernetes/pod_generator.py ## @@ -60,74 +71,118 @@

[jira] [Commented] (AIRFLOW-6058) Run tests with pytest

2019-12-10 Thread ASF subversion and git services (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6058?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16992472#comment-16992472 ] ASF subversion and git services commented on AIRFLOW-6058: -- Commit

[GitHub] [airflow] ashb opened a new pull request #6772: [AIRFLOW-XXX] Update airflow-jira release management script

2019-12-10 Thread GitBox
ashb opened a new pull request #6772: [AIRFLOW-XXX] Update airflow-jira release management script URL: https://github.com/apache/airflow/pull/6772 This PR is the changes I made to this script to make the last release -- it shows does a better job of finding merged PRs, linking "badly"

[GitHub] [airflow] ashb commented on issue #6772: [AIRFLOW-XXX] Update airflow-jira release management script

2019-12-10 Thread GitBox
ashb commented on issue #6772: [AIRFLOW-XXX] Update airflow-jira release management script URL: https://github.com/apache/airflow/pull/6772#issuecomment-564004756 You and your sensible solutions :P This is an automated

[GitHub] [airflow] KarimZaoui commented on issue #2708: [AIRFLOW-1746] Add a Nomad operator to trigger job from Airflow

2019-12-10 Thread GitBox
KarimZaoui commented on issue #2708: [AIRFLOW-1746] Add a Nomad operator to trigger job from Airflow URL: https://github.com/apache/airflow/pull/2708#issuecomment-564005130 @yiheng Any updates on this? This is an

[GitHub] [airflow] ashb commented on a change in pull request #6230: [AIRFLOW-5413] Allow K8S worker pod to be configured from JSON/YAML file

2019-12-10 Thread GitBox
ashb commented on a change in pull request #6230: [AIRFLOW-5413] Allow K8S worker pod to be configured from JSON/YAML file URL: https://github.com/apache/airflow/pull/6230#discussion_r356001522 ## File path: airflow/executors/kubernetes_executor.py ## @@ -372,7 +374,8 @@

[GitHub] [airflow] ashb commented on a change in pull request #6230: [AIRFLOW-5413] Allow K8S worker pod to be configured from JSON/YAML file

2019-12-10 Thread GitBox
ashb commented on a change in pull request #6230: [AIRFLOW-5413] Allow K8S worker pod to be configured from JSON/YAML file URL: https://github.com/apache/airflow/pull/6230#discussion_r356001323 ## File path: airflow/executors/kubernetes_executor.py ## @@ -372,7 +374,8 @@

[GitHub] [airflow] ashb commented on a change in pull request #6230: [AIRFLOW-5413] Allow K8S worker pod to be configured from JSON/YAML file

2019-12-10 Thread GitBox
ashb commented on a change in pull request #6230: [AIRFLOW-5413] Allow K8S worker pod to be configured from JSON/YAML file URL: https://github.com/apache/airflow/pull/6230#discussion_r356002028 ## File path: airflow/kubernetes/secret.py ## @@ -87,7 +87,7 @@ def

[jira] [Commented] (AIRFLOW-4176) [security] webui shows password - admin/log/?flt1_extra_contains=conn_password

2019-12-10 Thread xifeng (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-4176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16992330#comment-16992330 ] xifeng commented on AIRFLOW-4176: - is it still an issue? > [security] webui shows password -

[jira] [Created] (AIRFLOW-6214) Spark driver status tracking for standalone, YARN, Mesos and K8s with cluster deploy mode

2019-12-10 Thread Albertus Kelvin (Jira)
Albertus Kelvin created AIRFLOW-6214: Summary: Spark driver status tracking for standalone, YARN, Mesos and K8s with cluster deploy mode Key: AIRFLOW-6214 URL:

[GitHub] [airflow] codecov-io edited a comment on issue #6726: [AIRFLOW-6170] BranchPythonOperator does not do XCom push of returned value

2019-12-10 Thread GitBox
codecov-io edited a comment on issue #6726: [AIRFLOW-6170] BranchPythonOperator does not do XCom push of returned value URL: https://github.com/apache/airflow/pull/6726#issuecomment-561617155 # [Codecov](https://codecov.io/gh/apache/airflow/pull/6726?src=pr=h1) Report > :exclamation:

[GitHub] [airflow] codecov-io edited a comment on issue #6726: [AIRFLOW-6170] BranchPythonOperator does not do XCom push of returned value

2019-12-10 Thread GitBox
codecov-io edited a comment on issue #6726: [AIRFLOW-6170] BranchPythonOperator does not do XCom push of returned value URL: https://github.com/apache/airflow/pull/6726#issuecomment-561617155 # [Codecov](https://codecov.io/gh/apache/airflow/pull/6726?src=pr=h1) Report > :exclamation:

[GitHub] [airflow] codecov-io edited a comment on issue #6740: [AIRFLOW-6181] Add InProcessExecutor

2019-12-10 Thread GitBox
codecov-io edited a comment on issue #6740: [AIRFLOW-6181] Add InProcessExecutor URL: https://github.com/apache/airflow/pull/6740#issuecomment-562293656 # [Codecov](https://codecov.io/gh/apache/airflow/pull/6740?src=pr=h1) Report > Merging

[jira] [Commented] (AIRFLOW-5931) Spawning new python interpreter for every task slow

2019-12-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5931?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16992417#comment-16992417 ] ASF GitHub Bot commented on AIRFLOW-5931: - ashb commented on pull request #6627: [AIRFLOW-5931]

[jira] [Updated] (AIRFLOW-6216) Allow pytests to be run without "tests"

2019-12-10 Thread Jarek Potiuk (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6216?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jarek Potiuk updated AIRFLOW-6216: -- Description: With this change you should be able to simply run `pytest` to run all the tests

[jira] [Commented] (AIRFLOW-5931) Spawning new python interpreter for every task slow

2019-12-10 Thread ASF subversion and git services (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5931?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16992418#comment-16992418 ] ASF subversion and git services commented on AIRFLOW-5931: -- Commit

[jira] [Commented] (AIRFLOW-5931) Spawning new python interpreter for every task slow

2019-12-10 Thread ASF subversion and git services (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5931?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16992419#comment-16992419 ] ASF subversion and git services commented on AIRFLOW-5931: -- Commit

[jira] [Updated] (AIRFLOW-6216) Allow pytests to be run without "tests"

2019-12-10 Thread Jarek Potiuk (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6216?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jarek Potiuk updated AIRFLOW-6216: -- Description: With this change you should be able to simply run `pytest` to run all the tests

[jira] [Updated] (AIRFLOW-6121) Rename CloudBuildCreateBuildOperator

2019-12-10 Thread Jira
[ https://issues.apache.org/jira/browse/AIRFLOW-6121?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michał Słowikowski updated AIRFLOW-6121: Summary: Rename CloudBuildCreateBuildOperator (was: Rename cloud_build service)

[GitHub] [airflow] ashb commented on a change in pull request #6230: [AIRFLOW-5413] Allow K8S worker pod to be configured from JSON/YAML file

2019-12-10 Thread GitBox
ashb commented on a change in pull request #6230: [AIRFLOW-5413] Allow K8S worker pod to be configured from JSON/YAML file URL: https://github.com/apache/airflow/pull/6230#discussion_r355992984 ## File path: airflow/kubernetes/pod_generator.py ## @@ -298,51 +361,171 @@

[GitHub] [airflow] potiuk merged pull request #6739: [AIRFLOW-6183] Fix flaky GCS hook gzip test

2019-12-10 Thread GitBox
potiuk merged pull request #6739: [AIRFLOW-6183] Fix flaky GCS hook gzip test URL: https://github.com/apache/airflow/pull/6739 This is an automated message from the Apache Git Service. To respond to the message, please log

[jira] [Commented] (AIRFLOW-6183) Fix flaky GCS hook gzip test

2019-12-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16992478#comment-16992478 ] ASF GitHub Bot commented on AIRFLOW-6183: - potiuk commented on pull request #6739:

[jira] [Commented] (AIRFLOW-6183) Fix flaky GCS hook gzip test

2019-12-10 Thread ASF subversion and git services (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16992480#comment-16992480 ] ASF subversion and git services commented on AIRFLOW-6183: -- Commit

[jira] [Commented] (AIRFLOW-6183) Fix flaky GCS hook gzip test

2019-12-10 Thread ASF subversion and git services (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16992479#comment-16992479 ] ASF subversion and git services commented on AIRFLOW-6183: -- Commit

[GitHub] [airflow] ashb commented on issue #6760: [AIRFLOW-6157] Separate out common protocol for executors.

2019-12-10 Thread GitBox
ashb commented on issue #6760: [AIRFLOW-6157] Separate out common protocol for executors. URL: https://github.com/apache/airflow/pull/6760#issuecomment-564002923 > > I do not fully understand why we need this? Can you explain the difference between this protocol and the original base

[GitHub] [airflow] ashb commented on a change in pull request #6230: [AIRFLOW-5413] Allow K8S worker pod to be configured from JSON/YAML file

2019-12-10 Thread GitBox
ashb commented on a change in pull request #6230: [AIRFLOW-5413] Allow K8S worker pod to be configured from JSON/YAML file URL: https://github.com/apache/airflow/pull/6230#discussion_r356003667 ## File path: airflow/kubernetes/pod_generator.py ## @@ -298,51 +361,171 @@

[GitHub] [airflow] ashb commented on a change in pull request #6230: [AIRFLOW-5413] Allow K8S worker pod to be configured from JSON/YAML file

2019-12-10 Thread GitBox
ashb commented on a change in pull request #6230: [AIRFLOW-5413] Allow K8S worker pod to be configured from JSON/YAML file URL: https://github.com/apache/airflow/pull/6230#discussion_r356003407 ## File path: airflow/kubernetes/pod_generator.py ## @@ -298,51 +361,171 @@

[GitHub] [airflow] ashb commented on a change in pull request #6230: [AIRFLOW-5413] Allow K8S worker pod to be configured from JSON/YAML file

2019-12-10 Thread GitBox
ashb commented on a change in pull request #6230: [AIRFLOW-5413] Allow K8S worker pod to be configured from JSON/YAML file URL: https://github.com/apache/airflow/pull/6230#discussion_r356003939 ## File path: airflow/kubernetes/pod_generator.py ## @@ -301,51 +352,151 @@

[jira] [Updated] (AIRFLOW-6210) Reuse SQLAlchemy session in ti_deps

2019-12-10 Thread Kamil Bregula (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kamil Bregula updated AIRFLOW-6210: --- Description: This generates unnecessary overhead and it is good practice to use the

[jira] [Commented] (AIRFLOW-6215) BigQuery - use unittest assertions in hooks tests

2019-12-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16992364#comment-16992364 ] ASF GitHub Bot commented on AIRFLOW-6215: - TobKed commented on pull request #6769:

[jira] [Created] (AIRFLOW-6216) Allow pytests to be run without "tests"

2019-12-10 Thread Jarek Potiuk (Jira)
Jarek Potiuk created AIRFLOW-6216: - Summary: Allow pytests to be run without "tests" Key: AIRFLOW-6216 URL: https://issues.apache.org/jira/browse/AIRFLOW-6216 Project: Apache Airflow Issue

[GitHub] [airflow] ashb commented on a change in pull request #6660: [AIRFLOW-6065] Add Stackdriver Task Handler

2019-12-10 Thread GitBox
ashb commented on a change in pull request #6660: [AIRFLOW-6065] Add Stackdriver Task Handler URL: https://github.com/apache/airflow/pull/6660#discussion_r355963514 ## File path: docs/howto/write-logs.rst ## @@ -36,6 +36,38 @@ can not be found or accessed, local logs will

[GitHub] [airflow] ashb commented on a change in pull request #6660: [AIRFLOW-6065] Add Stackdriver Task Handler

2019-12-10 Thread GitBox
ashb commented on a change in pull request #6660: [AIRFLOW-6065] Add Stackdriver Task Handler URL: https://github.com/apache/airflow/pull/6660#discussion_r355964334 ## File path: docs/howto/write-logs.rst ## @@ -36,6 +36,38 @@ can not be found or accessed, local logs will

[GitHub] [airflow] ashb commented on a change in pull request #6230: [AIRFLOW-5413] Allow K8S worker pod to be configured from JSON/YAML file

2019-12-10 Thread GitBox
ashb commented on a change in pull request #6230: [AIRFLOW-5413] Allow K8S worker pod to be configured from JSON/YAML file URL: https://github.com/apache/airflow/pull/6230#discussion_r355991030 ## File path: airflow/executors/kubernetes_executor.py ## @@ -402,22 +405,30

[jira] [Commented] (AIRFLOW-6058) Run tests with pytest

2019-12-10 Thread ASF subversion and git services (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6058?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16992470#comment-16992470 ] ASF subversion and git services commented on AIRFLOW-6058: -- Commit

[jira] [Commented] (AIRFLOW-6058) Run tests with pytest

2019-12-10 Thread ASF subversion and git services (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6058?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16992471#comment-16992471 ] ASF subversion and git services commented on AIRFLOW-6058: -- Commit

[GitHub] [airflow] ashb commented on a change in pull request #6230: [AIRFLOW-5413] Allow K8S worker pod to be configured from JSON/YAML file

2019-12-10 Thread GitBox
ashb commented on a change in pull request #6230: [AIRFLOW-5413] Allow K8S worker pod to be configured from JSON/YAML file URL: https://github.com/apache/airflow/pull/6230#discussion_r356000124 ## File path: airflow/kubernetes/worker_configuration.py ## @@ -362,24 +366,17

[GitHub] [airflow] ashb commented on a change in pull request #6230: [AIRFLOW-5413] Allow K8S worker pod to be configured from JSON/YAML file

2019-12-10 Thread GitBox
ashb commented on a change in pull request #6230: [AIRFLOW-5413] Allow K8S worker pod to be configured from JSON/YAML file URL: https://github.com/apache/airflow/pull/6230#discussion_r35540 ## File path: airflow/kubernetes/worker_configuration.py ## @@ -389,11 +386,14

[jira] [Updated] (AIRFLOW-6183) Fix flaky GCS hook gzip test

2019-12-10 Thread Jarek Potiuk (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6183?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jarek Potiuk updated AIRFLOW-6183: -- Affects Version/s: (was: 1.10.7) > Fix flaky GCS hook gzip test >

  1   2   3   4   >