[GitHub] [airflow] nuclearpinguin closed pull request #6750: [WIP] [AIRFLOW-6329] Add AirflowExecutor and native worker

2020-01-16 Thread GitBox
nuclearpinguin closed pull request #6750: [WIP] [AIRFLOW-6329] Add AirflowExecutor and native worker URL: https://github.com/apache/airflow/pull/6750 This is an automated message from the Apache Git Service. To respond to

[jira] [Commented] (AIRFLOW-6329) Add AirflowExecutor and native worker

2020-01-16 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6329?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17016661#comment-17016661 ] ASF GitHub Bot commented on AIRFLOW-6329: - nuclearpinguin commented on pull request #6750:

[jira] [Commented] (AIRFLOW-6556) Improving unclear and incomplete documentation

2020-01-16 Thread Jacob Ward (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17016746#comment-17016746 ] Jacob Ward commented on AIRFLOW-6556: - Absolutely! > Improving unclear and incomplete

[jira] [Created] (AIRFLOW-6578) store_serialized_dags raises fatal error for reviewing logs

2020-01-16 Thread Xiaodong Ye (Jira)
Xiaodong Ye created AIRFLOW-6578: Summary: store_serialized_dags raises fatal error for reviewing logs Key: AIRFLOW-6578 URL: https://issues.apache.org/jira/browse/AIRFLOW-6578 Project: Apache

[jira] [Created] (AIRFLOW-6579) One of Celery executir tests is flaky

2020-01-16 Thread Jarek Potiuk (Jira)
Jarek Potiuk created AIRFLOW-6579: - Summary: One of Celery executir tests is flaky Key: AIRFLOW-6579 URL: https://issues.apache.org/jira/browse/AIRFLOW-6579 Project: Apache Airflow Issue

[GitHub] [airflow] nuclearpinguin opened a new pull request #7188: [AIRFLOW-XXXX] Add link for operators guide in first PR message

2020-01-16 Thread GitBox
nuclearpinguin opened a new pull request #7188: [AIRFLOW-] Add link for operators guide in first PR message URL: https://github.com/apache/airflow/pull/7188 Add link for operators guide in first PR message for new contributors. --- Issue link: WILL BE INSERTED BY

[jira] [Resolved] (AIRFLOW-6329) Add AirflowExecutor and native worker

2020-01-16 Thread Tomasz Urbaszek (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6329?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tomasz Urbaszek resolved AIRFLOW-6329. -- Resolution: Abandoned > Add AirflowExecutor and native worker >

[jira] [Commented] (AIRFLOW-6556) Improving unclear and incomplete documentation

2020-01-16 Thread Jarek Potiuk (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17016788#comment-17016788 ] Jarek Potiuk commented on AIRFLOW-6556: --- Cool. I don't promise anything super-fast, but I will

[GitHub] [airflow] Fokko commented on issue #4846: [AIRFLOW-4030] adding start to singularity for airflow

2020-01-16 Thread GitBox
Fokko commented on issue #4846: [AIRFLOW-4030] adding start to singularity for airflow URL: https://github.com/apache/airflow/pull/4846#issuecomment-575090955 @vsoch Personally I'm very happy to include Singularity support to Airflow, but we want to do this in a way that we enforce some

[GitHub] [airflow] potiuk commented on a change in pull request #7162: [AIRFLOW-6557] Add test for newly added fields in BaseOperator

2020-01-16 Thread GitBox
potiuk commented on a change in pull request #7162: [AIRFLOW-6557] Add test for newly added fields in BaseOperator URL: https://github.com/apache/airflow/pull/7162#discussion_r367413148 ## File path: tests/serialization/test_dag_serialization.py ## @@ -543,6 +543,68 @@

[jira] [Updated] (AIRFLOW-6535) add exception subclass to fail immediately without retrying

2020-01-16 Thread Jon Stern (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6535?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jon Stern updated AIRFLOW-6535: --- Component/s: documentation > add exception subclass to fail immediately without retrying >

[GitHub] [airflow] mik-laj opened a new pull request #7190: [AIRFLOW-XXX] Add cross-reference between connection and fernet

2020-01-16 Thread GitBox
mik-laj opened a new pull request #7190: [AIRFLOW-XXX] Add cross-reference between connection and fernet URL: https://github.com/apache/airflow/pull/7190 The `Manage connection` page contains very detailed information. However, it doesn't contain information about fernet. ---

[GitHub] [airflow] mbelang commented on issue #6643: [AIRFLOW-6040] Fix KubernetesJobWatcher Read time out error

2020-01-16 Thread GitBox
mbelang commented on issue #6643: [AIRFLOW-6040] Fix KubernetesJobWatcher Read time out error URL: https://github.com/apache/airflow/pull/6643#issuecomment-575214026 @maxirus Any progress? This is an automated message from

[GitHub] [airflow] vsoch commented on issue #4846: [AIRFLOW-4030] adding start to singularity for airflow

2020-01-16 Thread GitBox
vsoch commented on issue #4846: [AIRFLOW-4030] adding start to singularity for airflow URL: https://github.com/apache/airflow/pull/4846#issuecomment-575240752 > Hello @vsoch -> I am sorry you have this extra work, but unfortunately it happens and this is part of our normal process. This

[GitHub] [airflow] vsoch closed pull request #4846: [AIRFLOW-4030] adding start to singularity for airflow

2020-01-16 Thread GitBox
vsoch closed pull request #4846: [AIRFLOW-4030] adding start to singularity for airflow URL: https://github.com/apache/airflow/pull/4846 This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [airflow] potiuk commented on a change in pull request #7162: [AIRFLOW-6557] Add test for newly added fields in BaseOperator

2020-01-16 Thread GitBox
potiuk commented on a change in pull request #7162: [AIRFLOW-6557] Add test for newly added fields in BaseOperator URL: https://github.com/apache/airflow/pull/7162#discussion_r367413700 ## File path: tests/serialization/test_dag_serialization.py ## @@ -543,6 +543,68 @@

[GitHub] [airflow] mik-laj opened a new pull request #7189: [AIRFLOW-XXXX] Move email configuration from the concept page

2020-01-16 Thread GitBox
mik-laj opened a new pull request #7189: [AIRFLOW-] Move email configuration from the concept page URL: https://github.com/apache/airflow/pull/7189 Configuration is not a concept. These are two different matters and it is worth separating them. --- Issue link: WILL BE

[jira] [Commented] (AIRFLOW-6568) Add some more entries (Emacs related files) to .gitignore

2020-01-16 Thread ASF subversion and git services (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6568?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17017061#comment-17017061 ] ASF subversion and git services commented on AIRFLOW-6568: -- Commit

[jira] [Commented] (AIRFLOW-6568) Add some more entries (Emacs related files) to .gitignore

2020-01-16 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6568?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17017060#comment-17017060 ] ASF GitHub Bot commented on AIRFLOW-6568: - kaxil commented on pull request #7175:

[jira] [Resolved] (AIRFLOW-6568) Add some more entries (Emacs related files) to .gitignore

2020-01-16 Thread Kaxil Naik (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6568?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kaxil Naik resolved AIRFLOW-6568. - Fix Version/s: 2.0.0 Resolution: Fixed > Add some more entries (Emacs related files) to

[GitHub] [airflow] dazza-codes commented on a change in pull request #7027: [WIP][AIRFLOW-6441] KnativeExecutor

2020-01-16 Thread GitBox
dazza-codes commented on a change in pull request #7027: [WIP][AIRFLOW-6441] KnativeExecutor URL: https://github.com/apache/airflow/pull/7027#discussion_r367505849 ## File path: airflow/cli/commands/knative_worker_command.py ## @@ -0,0 +1,67 @@ +# -*- coding: utf-8 -*- +#

[GitHub] [airflow] codecov-io edited a comment on issue #7128: [AIRFLOW-6529] Pickle error occurs when the scheduler tries to run on macOS.

2020-01-16 Thread GitBox
codecov-io edited a comment on issue #7128: [AIRFLOW-6529] Pickle error occurs when the scheduler tries to run on macOS. URL: https://github.com/apache/airflow/pull/7128#issuecomment-573300577 # [Codecov](https://codecov.io/gh/apache/airflow/pull/7128?src=pr=h1) Report > :exclamation:

[GitHub] [airflow] codecov-io edited a comment on issue #7128: [AIRFLOW-6529] Pickle error occurs when the scheduler tries to run on macOS.

2020-01-16 Thread GitBox
codecov-io edited a comment on issue #7128: [AIRFLOW-6529] Pickle error occurs when the scheduler tries to run on macOS. URL: https://github.com/apache/airflow/pull/7128#issuecomment-573300577 # [Codecov](https://codecov.io/gh/apache/airflow/pull/7128?src=pr=h1) Report > :exclamation:

[GitHub] [airflow] ashb commented on a change in pull request #7128: [AIRFLOW-6529] Pickle error occurs when the scheduler tries to run on macOS.

2020-01-16 Thread GitBox
ashb commented on a change in pull request #7128: [AIRFLOW-6529] Pickle error occurs when the scheduler tries to run on macOS. URL: https://github.com/apache/airflow/pull/7128#discussion_r367407586 ## File path: airflow/jobs/scheduler_job.py ## @@ -126,7 +127,14 @@ def

[GitHub] [airflow] potiuk commented on a change in pull request #7175: [AIRFLOW-6568] Add some more entries (Emacs related files) to .gitignore

2020-01-16 Thread GitBox
potiuk commented on a change in pull request #7175: [AIRFLOW-6568] Add some more entries (Emacs related files) to .gitignore URL: https://github.com/apache/airflow/pull/7175#discussion_r367415247 ## File path: .gitignore ## @@ -129,6 +129,16 @@ ENV/ # vim *.swp +#

[GitHub] [airflow] potiuk commented on issue #7088: [WIP][AIRFLOW-6494] SSH host_proxy has to be fresh

2020-01-16 Thread GitBox
potiuk commented on issue #7088: [WIP][AIRFLOW-6494] SSH host_proxy has to be fresh URL: https://github.com/apache/airflow/pull/7088#issuecomment-575161505 Would it be too much to ask for a test covering this scenario of refresh (mocking Paramiko)?

[GitHub] [airflow] zhongjiajie commented on a change in pull request #7148: [AIRFLOW-6472] Correct short option in cli

2020-01-16 Thread GitBox
zhongjiajie commented on a change in pull request #7148: [AIRFLOW-6472] Correct short option in cli URL: https://github.com/apache/airflow/pull/7148#discussion_r367454779 ## File path: tests/bin/test_cli.py ## @@ -0,0 +1,139 @@ +#!/usr/bin/env python +# -*- coding: utf-8

[GitHub] [airflow] mik-laj commented on a change in pull request #7190: [AIRFLOW-XXXX] Add cross-reference between connection and fernet

2020-01-16 Thread GitBox
mik-laj commented on a change in pull request #7190: [AIRFLOW-] Add cross-reference between connection and fernet URL: https://github.com/apache/airflow/pull/7190#discussion_r367490433 ## File path: docs/howto/connection/index.rst ## @@ -221,6 +221,13 @@ To fix this,

[GitHub] [airflow] mik-laj commented on a change in pull request #7190: [AIRFLOW-XXXX] Add cross-reference between connection and fernet

2020-01-16 Thread GitBox
mik-laj commented on a change in pull request #7190: [AIRFLOW-] Add cross-reference between connection and fernet URL: https://github.com/apache/airflow/pull/7190#discussion_r367490433 ## File path: docs/howto/connection/index.rst ## @@ -221,6 +221,13 @@ To fix this,

[GitHub] [airflow] mik-laj commented on a change in pull request #7190: [AIRFLOW-XXXX] Add cross-reference between connection and fernet

2020-01-16 Thread GitBox
mik-laj commented on a change in pull request #7190: [AIRFLOW-] Add cross-reference between connection and fernet URL: https://github.com/apache/airflow/pull/7190#discussion_r367485195 ## File path: docs/howto/connection/index.rst ## @@ -221,6 +221,13 @@ To fix this,

[GitHub] [airflow] kaxil merged pull request #7175: [AIRFLOW-6568] Add some more entries (Emacs related files) to .gitignore

2020-01-16 Thread GitBox
kaxil merged pull request #7175: [AIRFLOW-6568] Add some more entries (Emacs related files) to .gitignore URL: https://github.com/apache/airflow/pull/7175 This is an automated message from the Apache Git Service. To

[GitHub] [airflow] vamega commented on a change in pull request #6850: [AIRFLOW-6296] add ODBC hook & deprecation warning for pymssql

2020-01-16 Thread GitBox
vamega commented on a change in pull request #6850: [AIRFLOW-6296] add ODBC hook & deprecation warning for pymssql URL: https://github.com/apache/airflow/pull/6850#discussion_r367530889 ## File path: airflow/providers/odbc/hooks/odbc.py ## @@ -0,0 +1,220 @@ +# Licensed to

[GitHub] [airflow] vamega commented on a change in pull request #6850: [AIRFLOW-6296] add ODBC hook & deprecation warning for pymssql

2020-01-16 Thread GitBox
vamega commented on a change in pull request #6850: [AIRFLOW-6296] add ODBC hook & deprecation warning for pymssql URL: https://github.com/apache/airflow/pull/6850#discussion_r367022367 ## File path: airflow/providers/odbc/hooks/odbc.py ## @@ -0,0 +1,220 @@ +# Licensed to

[GitHub] [airflow] vamega commented on a change in pull request #6850: [AIRFLOW-6296] add ODBC hook & deprecation warning for pymssql

2020-01-16 Thread GitBox
vamega commented on a change in pull request #6850: [AIRFLOW-6296] add ODBC hook & deprecation warning for pymssql URL: https://github.com/apache/airflow/pull/6850#discussion_r367497800 ## File path: docs/howto/connection/odbc.rst ## @@ -0,0 +1,107 @@ + .. Licensed to the

[GitHub] [airflow] vamega commented on a change in pull request #6850: [AIRFLOW-6296] add ODBC hook & deprecation warning for pymssql

2020-01-16 Thread GitBox
vamega commented on a change in pull request #6850: [AIRFLOW-6296] add ODBC hook & deprecation warning for pymssql URL: https://github.com/apache/airflow/pull/6850#discussion_r367021605 ## File path: airflow/providers/odbc/hooks/odbc.py ## @@ -0,0 +1,220 @@ +# Licensed to

[GitHub] [airflow] mik-laj commented on issue #4846: [AIRFLOW-4030] adding start to singularity for airflow

2020-01-16 Thread GitBox
mik-laj commented on issue #4846: [AIRFLOW-4030] adding start to singularity for airflow URL: https://github.com/apache/airflow/pull/4846#issuecomment-575141267 It seems to me that the problem arose because of performing merge instead of performing rebase. Merge can cause random issues in

[GitHub] [airflow] potiuk commented on issue #4846: [AIRFLOW-4030] adding start to singularity for airflow

2020-01-16 Thread GitBox
potiuk commented on issue #4846: [AIRFLOW-4030] adding start to singularity for airflow URL: https://github.com/apache/airflow/pull/4846#issuecomment-575146487 Hello @vsoch -> I am sorry you have this extra work, but unfortunately it happens and this is part of our normal process. This is

[GitHub] [airflow] sarutak commented on a change in pull request #7128: [AIRFLOW-6529] Pickle error occurs when the scheduler tries to run on macOS.

2020-01-16 Thread GitBox
sarutak commented on a change in pull request #7128: [AIRFLOW-6529] Pickle error occurs when the scheduler tries to run on macOS. URL: https://github.com/apache/airflow/pull/7128#discussion_r367435592 ## File path: airflow/utils/dag_processing.py ## @@ -388,12 +415,20 @@

[GitHub] [airflow] codecov-io commented on issue #6792: [AIRFLOW-5930] Use cached-SQL query building for hot-path queries

2020-01-16 Thread GitBox
codecov-io commented on issue #6792: [AIRFLOW-5930] Use cached-SQL query building for hot-path queries URL: https://github.com/apache/airflow/pull/6792#issuecomment-575233091 # [Codecov](https://codecov.io/gh/apache/airflow/pull/6792?src=pr=h1) Report > Merging

[GitHub] [airflow] sarutak commented on a change in pull request #7128: [AIRFLOW-6529] Pickle error occurs when the scheduler tries to run on macOS.

2020-01-16 Thread GitBox
sarutak commented on a change in pull request #7128: [AIRFLOW-6529] Pickle error occurs when the scheduler tries to run on macOS. URL: https://github.com/apache/airflow/pull/7128#discussion_r367410298 ## File path: airflow/jobs/scheduler_job.py ## @@ -126,7 +127,14 @@ def

[GitHub] [airflow] sarutak commented on a change in pull request #7128: [AIRFLOW-6529] Pickle error occurs when the scheduler tries to run on macOS.

2020-01-16 Thread GitBox
sarutak commented on a change in pull request #7128: [AIRFLOW-6529] Pickle error occurs when the scheduler tries to run on macOS. URL: https://github.com/apache/airflow/pull/7128#discussion_r367418143 ## File path: airflow/utils/dag_processing.py ## @@ -388,12 +415,20 @@

[GitHub] [airflow] kaxil commented on a change in pull request #7190: [AIRFLOW-XXXX] Add cross-reference between connection and fernet

2020-01-16 Thread GitBox
kaxil commented on a change in pull request #7190: [AIRFLOW-] Add cross-reference between connection and fernet URL: https://github.com/apache/airflow/pull/7190#discussion_r367477888 ## File path: docs/howto/connection/index.rst ## @@ -221,6 +221,13 @@ To fix this,

[GitHub] [airflow] mik-laj commented on a change in pull request #7190: [AIRFLOW-XXXX] Add cross-reference between connection and fernet

2020-01-16 Thread GitBox
mik-laj commented on a change in pull request #7190: [AIRFLOW-] Add cross-reference between connection and fernet URL: https://github.com/apache/airflow/pull/7190#discussion_r367485195 ## File path: docs/howto/connection/index.rst ## @@ -221,6 +221,13 @@ To fix this,

[GitHub] [airflow] mik-laj commented on a change in pull request #7190: [AIRFLOW-XXXX] Add cross-reference between connection and fernet

2020-01-16 Thread GitBox
mik-laj commented on a change in pull request #7190: [AIRFLOW-] Add cross-reference between connection and fernet URL: https://github.com/apache/airflow/pull/7190#discussion_r367485195 ## File path: docs/howto/connection/index.rst ## @@ -221,6 +221,13 @@ To fix this,

[GitHub] [airflow] mik-laj commented on a change in pull request #7190: [AIRFLOW-XXXX] Add cross-reference between connection and fernet

2020-01-16 Thread GitBox
mik-laj commented on a change in pull request #7190: [AIRFLOW-] Add cross-reference between connection and fernet URL: https://github.com/apache/airflow/pull/7190#discussion_r367485195 ## File path: docs/howto/connection/index.rst ## @@ -221,6 +221,13 @@ To fix this,

[GitHub] [airflow] dazza-codes commented on a change in pull request #7027: [WIP][AIRFLOW-6441] KnativeExecutor

2020-01-16 Thread GitBox
dazza-codes commented on a change in pull request #7027: [WIP][AIRFLOW-6441] KnativeExecutor URL: https://github.com/apache/airflow/pull/7027#discussion_r367507948 ## File path: airflow/executors/knative_executor.py ## @@ -0,0 +1,210 @@ +# -*- coding: utf-8 -*- +# +#

[GitHub] [airflow] hmike96 commented on issue #6230: [AIRFLOW-5413] Allow K8S worker pod to be configured from JSON/YAML file

2020-01-16 Thread GitBox
hmike96 commented on issue #6230: [AIRFLOW-5413] Allow K8S worker pod to be configured from JSON/YAML file URL: https://github.com/apache/airflow/pull/6230#issuecomment-575229660 Is the full_pod_spec feature released yet?? I tried it out but get this bug as if it is not released? `

[GitHub] [airflow] potiuk commented on a change in pull request #7162: [AIRFLOW-6557] Add test for newly added fields in BaseOperator

2020-01-16 Thread GitBox
potiuk commented on a change in pull request #7162: [AIRFLOW-6557] Add test for newly added fields in BaseOperator URL: https://github.com/apache/airflow/pull/7162#discussion_r367413700 ## File path: tests/serialization/test_dag_serialization.py ## @@ -543,6 +543,68 @@

[GitHub] [airflow] codecov-io edited a comment on issue #7162: [AIRFLOW-6557] Add test for newly added fields in BaseOperator

2020-01-16 Thread GitBox
codecov-io edited a comment on issue #7162: [AIRFLOW-6557] Add test for newly added fields in BaseOperator URL: https://github.com/apache/airflow/pull/7162#issuecomment-574227743 # [Codecov](https://codecov.io/gh/apache/airflow/pull/7162?src=pr=h1) Report > Merging

[GitHub] [airflow] codecov-io edited a comment on issue #7160: [AIRFLOW-1467] Dynamic pooling via allowing tasks to use more than one pool slot (depending upon the need)

2020-01-16 Thread GitBox
codecov-io edited a comment on issue #7160: [AIRFLOW-1467] Dynamic pooling via allowing tasks to use more than one pool slot (depending upon the need) URL: https://github.com/apache/airflow/pull/7160#issuecomment-574096290 #

[GitHub] [airflow] codecov-io edited a comment on issue #7160: [AIRFLOW-1467] Dynamic pooling via allowing tasks to use more than one pool slot (depending upon the need)

2020-01-16 Thread GitBox
codecov-io edited a comment on issue #7160: [AIRFLOW-1467] Dynamic pooling via allowing tasks to use more than one pool slot (depending upon the need) URL: https://github.com/apache/airflow/pull/7160#issuecomment-574096290 #

[GitHub] [airflow] codecov-io edited a comment on issue #7160: [AIRFLOW-1467] Dynamic pooling via allowing tasks to use more than one pool slot (depending upon the need)

2020-01-16 Thread GitBox
codecov-io edited a comment on issue #7160: [AIRFLOW-1467] Dynamic pooling via allowing tasks to use more than one pool slot (depending upon the need) URL: https://github.com/apache/airflow/pull/7160#issuecomment-574096290 #

[GitHub] [airflow] dazza-codes commented on a change in pull request #7027: [WIP][AIRFLOW-6441] KnativeExecutor

2020-01-16 Thread GitBox
dazza-codes commented on a change in pull request #7027: [WIP][AIRFLOW-6441] KnativeExecutor URL: https://github.com/apache/airflow/pull/7027#discussion_r367505849 ## File path: airflow/cli/commands/knative_worker_command.py ## @@ -0,0 +1,67 @@ +# -*- coding: utf-8 -*- +#

[jira] [Commented] (AIRFLOW-4030) Add Singularity Container Operator

2020-01-16 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-4030?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17017309#comment-17017309 ] ASF GitHub Bot commented on AIRFLOW-4030: - vsoch commented on pull request #7191:

[jira] [Resolved] (AIRFLOW-5501) in_cluster default value in KubernetesPodOperator overwrites configuration

2020-01-16 Thread Ash Berlin-Taylor (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5501?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ash Berlin-Taylor resolved AIRFLOW-5501. Fix Version/s: 1.10.8 Resolution: Fixed > in_cluster default value in

[jira] [Commented] (AIRFLOW-5501) in_cluster default value in KubernetesPodOperator overwrites configuration

2020-01-16 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5501?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17017305#comment-17017305 ] ASF GitHub Bot commented on AIRFLOW-5501: - ashb commented on pull request #6124: [AIRFLOW-5501]

[jira] [Commented] (AIRFLOW-5501) in_cluster default value in KubernetesPodOperator overwrites configuration

2020-01-16 Thread ASF subversion and git services (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5501?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17017306#comment-17017306 ] ASF subversion and git services commented on AIRFLOW-5501: -- Commit

[GitHub] [airflow] vsoch opened a new pull request #7191: [AIRFLOW-4030] second attempt to add singularity to airflow

2020-01-16 Thread GitBox
vsoch opened a new pull request #7191: [AIRFLOW-4030] second attempt to add singularity to airflow URL: https://github.com/apache/airflow/pull/7191 This is a second attempt to add Singularity Container support to Apache Airflow by way of Singularity Python. I am using the previously

[GitHub] [airflow] sarutak commented on a change in pull request #7128: [AIRFLOW-6529] Pickle error occurs when the scheduler tries to run on macOS.

2020-01-16 Thread GitBox
sarutak commented on a change in pull request #7128: [AIRFLOW-6529] Pickle error occurs when the scheduler tries to run on macOS. URL: https://github.com/apache/airflow/pull/7128#discussion_r367409255 ## File path: airflow/utils/dag_processing.py ## @@ -388,12 +415,20 @@

[GitHub] [airflow] potiuk commented on issue #7160: [AIRFLOW-1467] Dynamic pooling via allowing tasks to use more than one pool slot (depending upon the need)

2020-01-16 Thread GitBox
potiuk commented on issue #7160: [AIRFLOW-1467] Dynamic pooling via allowing tasks to use more than one pool slot (depending upon the need) URL: https://github.com/apache/airflow/pull/7160#issuecomment-575169715 So just update the json @lokeshlal. Here is the current message that you will

[GitHub] [airflow] mik-laj commented on a change in pull request #7190: [AIRFLOW-XXXX] Add cross-reference between connection and fernet

2020-01-16 Thread GitBox
mik-laj commented on a change in pull request #7190: [AIRFLOW-] Add cross-reference between connection and fernet URL: https://github.com/apache/airflow/pull/7190#discussion_r367485195 ## File path: docs/howto/connection/index.rst ## @@ -221,6 +221,13 @@ To fix this,

[GitHub] [airflow] nuclearpinguin merged pull request #7189: [AIRFLOW-XXXX] Move email configuration from the concept page

2020-01-16 Thread GitBox
nuclearpinguin merged pull request #7189: [AIRFLOW-] Move email configuration from the concept page URL: https://github.com/apache/airflow/pull/7189 This is an automated message from the Apache Git Service. To respond

[GitHub] [airflow] ashb commented on issue #7153: [AIRFLOW-5117] Fixed Timestamp bug in RefreshKubeConfigLoader

2020-01-16 Thread GitBox
ashb commented on issue #7153: [AIRFLOW-5117] Fixed Timestamp bug in RefreshKubeConfigLoader URL: https://github.com/apache/airflow/pull/7153#issuecomment-575237800 Change looks good now, but as this JIRA was already released we need a new JIRA please. (We use the Fix Version to know what

[GitHub] [airflow] ashb merged pull request #6124: [AIRFLOW-5501] in_cluster default value in KubernetesPodOperator overwrites configuration

2020-01-16 Thread GitBox
ashb merged pull request #6124: [AIRFLOW-5501] in_cluster default value in KubernetesPodOperator overwrites configuration URL: https://github.com/apache/airflow/pull/6124 This is an automated message from the Apache Git

[GitHub] [airflow] ashb commented on a change in pull request #7128: [AIRFLOW-6529] Pickle error occurs when the scheduler tries to run on macOS.

2020-01-16 Thread GitBox
ashb commented on a change in pull request #7128: [AIRFLOW-6529] Pickle error occurs when the scheduler tries to run on macOS. URL: https://github.com/apache/airflow/pull/7128#discussion_r367406829 ## File path: airflow/utils/dag_processing.py ## @@ -388,12 +415,20 @@ def

[jira] [Commented] (AIRFLOW-3421) CSS issue on Airflow 1.10 Tree view UI

2020-01-16 Thread Court Sansom (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-3421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17016958#comment-17016958 ] Court Sansom commented on AIRFLOW-3421: --- I can confirm the issue persists in 1.10.4. > CSS issue

[GitHub] [airflow] lokeshlal commented on issue #7160: [AIRFLOW-1467] Dynamic pooling via allowing tasks to use more than one pool slot (depending upon the need)

2020-01-16 Thread GitBox
lokeshlal commented on issue #7160: [AIRFLOW-1467] Dynamic pooling via allowing tasks to use more than one pool slot (depending upon the need) URL: https://github.com/apache/airflow/pull/7160#issuecomment-575173295 Thanks @potiuk - I have already updated schema.json file with pool_slots

[GitHub] [airflow] mik-laj commented on a change in pull request #7190: [AIRFLOW-XXXX] Add cross-reference between connection and fernet

2020-01-16 Thread GitBox
mik-laj commented on a change in pull request #7190: [AIRFLOW-] Add cross-reference between connection and fernet URL: https://github.com/apache/airflow/pull/7190#discussion_r367485195 ## File path: docs/howto/connection/index.rst ## @@ -221,6 +221,13 @@ To fix this,

[GitHub] [airflow] mik-laj commented on a change in pull request #7190: [AIRFLOW-XXXX] Add cross-reference between connection and fernet

2020-01-16 Thread GitBox
mik-laj commented on a change in pull request #7190: [AIRFLOW-] Add cross-reference between connection and fernet URL: https://github.com/apache/airflow/pull/7190#discussion_r367485195 ## File path: docs/howto/connection/index.rst ## @@ -221,6 +221,13 @@ To fix this,

[GitHub] [airflow] davlum commented on issue #6230: [AIRFLOW-5413] Allow K8S worker pod to be configured from JSON/YAML file

2020-01-16 Thread GitBox
davlum commented on issue #6230: [AIRFLOW-5413] Allow K8S worker pod to be configured from JSON/YAML file URL: https://github.com/apache/airflow/pull/6230#issuecomment-575232284 @hmike96 `full_pod_spec` is not yet released. [Here is the source code for the KubernetesPodOperator in Airflow

[jira] [Commented] (AIRFLOW-4030) Add Singularity Container Operator

2020-01-16 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-4030?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17017291#comment-17017291 ] ASF GitHub Bot commented on AIRFLOW-4030: - vsoch commented on pull request #4846:

[GitHub] [airflow] ashb commented on a change in pull request #7128: [AIRFLOW-6529] Pickle error occurs when the scheduler tries to run on macOS.

2020-01-16 Thread GitBox
ashb commented on a change in pull request #7128: [AIRFLOW-6529] Pickle error occurs when the scheduler tries to run on macOS. URL: https://github.com/apache/airflow/pull/7128#discussion_r367406479 ## File path: airflow/utils/dag_processing.py ## @@ -388,12 +415,20 @@ def

[GitHub] [airflow] potiuk commented on a change in pull request #7148: [AIRFLOW-6472] Correct short option in cli

2020-01-16 Thread GitBox
potiuk commented on a change in pull request #7148: [AIRFLOW-6472] Correct short option in cli URL: https://github.com/apache/airflow/pull/7148#discussion_r367412205 ## File path: tests/bin/test_cli.py ## @@ -0,0 +1,139 @@ +#!/usr/bin/env python +# -*- coding: utf-8 -*-

[GitHub] [airflow] mik-laj commented on a change in pull request #7190: [AIRFLOW-XXXX] Add cross-reference between connection and fernet

2020-01-16 Thread GitBox
mik-laj commented on a change in pull request #7190: [AIRFLOW-] Add cross-reference between connection and fernet URL: https://github.com/apache/airflow/pull/7190#discussion_r367485195 ## File path: docs/howto/connection/index.rst ## @@ -221,6 +221,13 @@ To fix this,

[GitHub] [airflow] mik-laj commented on a change in pull request #7190: [AIRFLOW-XXXX] Add cross-reference between connection and fernet

2020-01-16 Thread GitBox
mik-laj commented on a change in pull request #7190: [AIRFLOW-] Add cross-reference between connection and fernet URL: https://github.com/apache/airflow/pull/7190#discussion_r367485786 ## File path: docs/howto/connection/index.rst ## @@ -221,6 +221,13 @@ To fix this,

[GitHub] [airflow] mik-laj commented on a change in pull request #7190: [AIRFLOW-XXXX] Add cross-reference between connection and fernet

2020-01-16 Thread GitBox
mik-laj commented on a change in pull request #7190: [AIRFLOW-] Add cross-reference between connection and fernet URL: https://github.com/apache/airflow/pull/7190#discussion_r367485195 ## File path: docs/howto/connection/index.rst ## @@ -221,6 +221,13 @@ To fix this,

[GitHub] [airflow] mik-laj commented on a change in pull request #7190: [AIRFLOW-XXXX] Add cross-reference between connection and fernet

2020-01-16 Thread GitBox
mik-laj commented on a change in pull request #7190: [AIRFLOW-] Add cross-reference between connection and fernet URL: https://github.com/apache/airflow/pull/7190#discussion_r367485195 ## File path: docs/howto/connection/index.rst ## @@ -221,6 +221,13 @@ To fix this,

[GitHub] [airflow] mik-laj commented on a change in pull request #7190: [AIRFLOW-XXXX] Add cross-reference between connection and fernet

2020-01-16 Thread GitBox
mik-laj commented on a change in pull request #7190: [AIRFLOW-] Add cross-reference between connection and fernet URL: https://github.com/apache/airflow/pull/7190#discussion_r367485195 ## File path: docs/howto/connection/index.rst ## @@ -221,6 +221,13 @@ To fix this,

[GitHub] [airflow] nuclearpinguin commented on a change in pull request #7146: [AIRFLOW-6541] Use EmrJobFlowSensor for other states

2020-01-16 Thread GitBox
nuclearpinguin commented on a change in pull request #7146: [AIRFLOW-6541] Use EmrJobFlowSensor for other states URL: https://github.com/apache/airflow/pull/7146#discussion_r367495835 ## File path: airflow/contrib/sensors/emr_job_flow_sensor.py ## @@ -16,48 +16,96 @@ #

[GitHub] [airflow] nuclearpinguin commented on a change in pull request #7146: [AIRFLOW-6541] Use EmrJobFlowSensor for other states

2020-01-16 Thread GitBox
nuclearpinguin commented on a change in pull request #7146: [AIRFLOW-6541] Use EmrJobFlowSensor for other states URL: https://github.com/apache/airflow/pull/7146#discussion_r367498157 ## File path: airflow/contrib/sensors/emr_step_sensor.py ## @@ -16,52 +16,102 @@ #

[GitHub] [airflow] nuclearpinguin commented on a change in pull request #7146: [AIRFLOW-6541] Use EmrJobFlowSensor for other states

2020-01-16 Thread GitBox
nuclearpinguin commented on a change in pull request #7146: [AIRFLOW-6541] Use EmrJobFlowSensor for other states URL: https://github.com/apache/airflow/pull/7146#discussion_r367497128 ## File path: airflow/contrib/sensors/emr_job_flow_sensor.py ## @@ -16,48 +16,96 @@ #

[GitHub] [airflow] nuclearpinguin commented on a change in pull request #7146: [AIRFLOW-6541] Use EmrJobFlowSensor for other states

2020-01-16 Thread GitBox
nuclearpinguin commented on a change in pull request #7146: [AIRFLOW-6541] Use EmrJobFlowSensor for other states URL: https://github.com/apache/airflow/pull/7146#discussion_r367496595 ## File path: airflow/contrib/sensors/emr_job_flow_sensor.py ## @@ -16,48 +16,96 @@ #

[GitHub] [airflow] kaxil commented on a change in pull request #7190: [AIRFLOW-XXXX] Add cross-reference between connection and fernet

2020-01-16 Thread GitBox
kaxil commented on a change in pull request #7190: [AIRFLOW-] Add cross-reference between connection and fernet URL: https://github.com/apache/airflow/pull/7190#discussion_r367498997 ## File path: docs/howto/connection/index.rst ## @@ -221,6 +221,13 @@ To fix this,

[GitHub] [airflow] ashb commented on issue #6792: [AIRFLOW-5930] Use cached-SQL query building for hot-path queries

2020-01-16 Thread GitBox
ashb commented on issue #6792: [AIRFLOW-5930] Use cached-SQL query building for hot-path queries URL: https://github.com/apache/airflow/pull/6792#issuecomment-575220751 Updated numbers from master branch. I'm not sure these will equate to _such_ a speed up in terms of actual task

[GitHub] [airflow] larryzhu2018 commented on issue #7141: [AIRFLOW-6544] add log_id to end-of-file mark and also add an index config for logs

2020-01-16 Thread GitBox
larryzhu2018 commented on issue #7141: [AIRFLOW-6544] add log_id to end-of-file mark and also add an index config for logs URL: https://github.com/apache/airflow/pull/7141#issuecomment-575254776 > * g another ticket? Please see the test case, I need the index parameter so that I can

[GitHub] [airflow] ashb commented on a change in pull request #4751: [AIRFLOW-3607] collected trigger rule dep check per dag run

2020-01-16 Thread GitBox
ashb commented on a change in pull request #4751: [AIRFLOW-3607] collected trigger rule dep check per dag run URL: https://github.com/apache/airflow/pull/4751#discussion_r367549812 ## File path: tests/models/test_dagrun.py ## @@ -234,8 +234,9 @@ def

[GitHub] [airflow] dstandish commented on a change in pull request #6850: [AIRFLOW-6296] add ODBC hook & deprecation warning for pymssql

2020-01-16 Thread GitBox
dstandish commented on a change in pull request #6850: [AIRFLOW-6296] add ODBC hook & deprecation warning for pymssql URL: https://github.com/apache/airflow/pull/6850#discussion_r367559741 ## File path: airflow/providers/odbc/hooks/odbc.py ## @@ -0,0 +1,220 @@ +# Licensed

[GitHub] [airflow] dstandish commented on a change in pull request #6850: [AIRFLOW-6296] add ODBC hook & deprecation warning for pymssql

2020-01-16 Thread GitBox
dstandish commented on a change in pull request #6850: [AIRFLOW-6296] add ODBC hook & deprecation warning for pymssql URL: https://github.com/apache/airflow/pull/6850#discussion_r367559741 ## File path: airflow/providers/odbc/hooks/odbc.py ## @@ -0,0 +1,220 @@ +# Licensed

[GitHub] [airflow] codecov-io edited a comment on issue #4751: [AIRFLOW-3607] collected trigger rule dep check per dag run

2020-01-16 Thread GitBox
codecov-io edited a comment on issue #4751: [AIRFLOW-3607] collected trigger rule dep check per dag run URL: https://github.com/apache/airflow/pull/4751#issuecomment-466029246 # [Codecov](https://codecov.io/gh/apache/airflow/pull/4751?src=pr=h1) Report > Merging

[GitHub] [airflow] amichai07 commented on a change in pull request #4751: [AIRFLOW-3607] collected trigger rule dep check per dag run

2020-01-16 Thread GitBox
amichai07 commented on a change in pull request #4751: [AIRFLOW-3607] collected trigger rule dep check per dag run URL: https://github.com/apache/airflow/pull/4751#discussion_r367599292 ## File path: tests/models/test_dagrun.py ## @@ -234,8 +234,9 @@ def

[GitHub] [airflow] codecov-io edited a comment on issue #5785: [AIRFLOW-5176] Add Azure Data Explorer (Kusto) operator

2020-01-16 Thread GitBox
codecov-io edited a comment on issue #5785: [AIRFLOW-5176] Add Azure Data Explorer (Kusto) operator URL: https://github.com/apache/airflow/pull/5785#issuecomment-553413704 # [Codecov](https://codecov.io/gh/apache/airflow/pull/5785?src=pr=h1) Report > Merging

[GitHub] [airflow] potiuk edited a comment on issue #4846: [AIRFLOW-4030] adding start to singularity for airflow

2020-01-16 Thread GitBox
potiuk edited a comment on issue #4846: [AIRFLOW-4030] adding start to singularity for airflow URL: https://github.com/apache/airflow/pull/4846#issuecomment-575337231 Just to make sure we understand each other - I am not defensive, I really try to understand and put in actions some of the

[GitHub] [airflow] stale[bot] closed pull request #6277: [AIRFLOW-2971] Add health check CLI for scheduler

2020-01-16 Thread GitBox
stale[bot] closed pull request #6277: [AIRFLOW-2971] Add health check CLI for scheduler URL: https://github.com/apache/airflow/pull/6277 This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [airflow] dstandish commented on a change in pull request #6850: [AIRFLOW-6296] add ODBC hook & deprecation warning for pymssql

2020-01-16 Thread GitBox
dstandish commented on a change in pull request #6850: [AIRFLOW-6296] add ODBC hook & deprecation warning for pymssql URL: https://github.com/apache/airflow/pull/6850#discussion_r367632414 ## File path: docs/howto/connection/odbc.rst ## @@ -0,0 +1,107 @@ + .. Licensed to

[GitHub] [airflow] dstandish commented on a change in pull request #6850: [AIRFLOW-6296] add ODBC hook & deprecation warning for pymssql

2020-01-16 Thread GitBox
dstandish commented on a change in pull request #6850: [AIRFLOW-6296] add ODBC hook & deprecation warning for pymssql URL: https://github.com/apache/airflow/pull/6850#discussion_r367629138 ## File path: docs/howto/connection/odbc.rst ## @@ -0,0 +1,107 @@ + .. Licensed to

[GitHub] [airflow] potiuk opened a new pull request #7193: [AIRFLOW-XXXX] Adds branching strategy to documentation

2020-01-16 Thread GitBox
potiuk opened a new pull request #7193: [AIRFLOW-] Adds branching strategy to documentation URL: https://github.com/apache/airflow/pull/7193 --- Issue link: WILL BE INSERTED BY [boring-cyborg](https://github.com/kaxil/boring-cyborg) Make sure to mark the boxes below before

[jira] [Commented] (AIRFLOW-6556) Improving unclear and incomplete documentation

2020-01-16 Thread Jarek Potiuk (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17017504#comment-17017504 ] Jarek Potiuk commented on AIRFLOW-6556: --- [~uncletoxa] (y) > Improving unclear and incomplete

[GitHub] [airflow] dstandish commented on a change in pull request #6850: [AIRFLOW-6296] add ODBC hook & deprecation warning for pymssql

2020-01-16 Thread GitBox
dstandish commented on a change in pull request #6850: [AIRFLOW-6296] add ODBC hook & deprecation warning for pymssql URL: https://github.com/apache/airflow/pull/6850#discussion_r367554581 ## File path: airflow/providers/odbc/hooks/odbc.py ## @@ -0,0 +1,220 @@ +# Licensed

[jira] [Commented] (AIRFLOW-2971) Health check command for scheduler

2020-01-16 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-2971?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17017330#comment-17017330 ] ASF GitHub Bot commented on AIRFLOW-2971: - stale[bot] commented on pull request #6277:

[GitHub] [airflow] lucafuji commented on issue #6870: [AIRFLOW-0578] Check return code

2020-01-16 Thread GitBox
lucafuji commented on issue #6870: [AIRFLOW-0578] Check return code URL: https://github.com/apache/airflow/pull/6870#issuecomment-575284775 @ashb ^^ This is an automated message from the Apache Git Service. To respond to the

  1   2   >