[GitHub] [airflow] ashb commented on issue #5908: Revert "[AIRFLOW-4797] Improve performance and behaviour of zombie de…

2019-10-14 Thread GitBox
ashb commented on issue #5908: Revert "[AIRFLOW-4797] Improve performance and behaviour of zombie de… URL: https://github.com/apache/airflow/pull/5908#issuecomment-541913557 Probably worth doing this PR as a "Rebase and merge" rather than our normal "Squash and merge" so the revert and

[GitHub] [airflow] ashb commented on a change in pull request #5913: [AIRFLOW-5073] Change SQLSensor to treat NULL failure

2019-10-14 Thread GitBox
ashb commented on a change in pull request #5913: [AIRFLOW-5073] Change SQLSensor to treat NULL failure URL: https://github.com/apache/airflow/pull/5913#discussion_r334649773 ## File path: airflow/sensors/sql_sensor.py ## @@ -102,6 +98,4 @@ def poke(self, context):

[GitHub] [airflow] ashb merged pull request #6314: [AIRFLOW-5497] Update docstring with param description

2019-10-14 Thread GitBox
ashb merged pull request #6314: [AIRFLOW-5497] Update docstring with param description URL: https://github.com/apache/airflow/pull/6314 This is an automated message from the Apache Git Service. To respond to the message,

[jira] [Commented] (AIRFLOW-5497) dag_processing::list_py_file_paths method pydoc needs param added

2019-10-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16951351#comment-16951351 ] ASF GitHub Bot commented on AIRFLOW-5497: - ashb commented on pull request #6314: [AIRFLOW-5497]

[jira] [Commented] (AIRFLOW-5497) dag_processing::list_py_file_paths method pydoc needs param added

2019-10-14 Thread ASF subversion and git services (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16951352#comment-16951352 ] ASF subversion and git services commented on AIRFLOW-5497: -- Commit

[GitHub] [airflow] codecov-io commented on issue #5908: Revert "[AIRFLOW-4797] Improve performance and behaviour of zombie de…

2019-10-14 Thread GitBox
codecov-io commented on issue #5908: Revert "[AIRFLOW-4797] Improve performance and behaviour of zombie de… URL: https://github.com/apache/airflow/pull/5908#issuecomment-541951179 # [Codecov](https://codecov.io/gh/apache/airflow/pull/5908?src=pr=h1) Report > Merging

[GitHub] [airflow] codecov-io edited a comment on issue #5908: Revert "[AIRFLOW-4797] Improve performance and behaviour of zombie de…

2019-10-14 Thread GitBox
codecov-io edited a comment on issue #5908: Revert "[AIRFLOW-4797] Improve performance and behaviour of zombie de… URL: https://github.com/apache/airflow/pull/5908#issuecomment-541951179 # [Codecov](https://codecov.io/gh/apache/airflow/pull/5908?src=pr=h1) Report > Merging

[GitHub] [airflow] codecov-io edited a comment on issue #5908: Revert "[AIRFLOW-4797] Improve performance and behaviour of zombie de…

2019-10-14 Thread GitBox
codecov-io edited a comment on issue #5908: Revert "[AIRFLOW-4797] Improve performance and behaviour of zombie de… URL: https://github.com/apache/airflow/pull/5908#issuecomment-541951179 # [Codecov](https://codecov.io/gh/apache/airflow/pull/5908?src=pr=h1) Report > Merging

[GitHub] [airflow] codecov-io edited a comment on issue #5908: Revert "[AIRFLOW-4797] Improve performance and behaviour of zombie de…

2019-10-14 Thread GitBox
codecov-io edited a comment on issue #5908: Revert "[AIRFLOW-4797] Improve performance and behaviour of zombie de… URL: https://github.com/apache/airflow/pull/5908#issuecomment-541951179 # [Codecov](https://codecov.io/gh/apache/airflow/pull/5908?src=pr=h1) Report > Merging

[GitHub] [airflow] codecov-io edited a comment on issue #5908: Revert "[AIRFLOW-4797] Improve performance and behaviour of zombie de…

2019-10-14 Thread GitBox
codecov-io edited a comment on issue #5908: Revert "[AIRFLOW-4797] Improve performance and behaviour of zombie de… URL: https://github.com/apache/airflow/pull/5908#issuecomment-541951179 # [Codecov](https://codecov.io/gh/apache/airflow/pull/5908?src=pr=h1) Report > Merging

[GitHub] [airflow] codecov-io edited a comment on issue #5908: Revert "[AIRFLOW-4797] Improve performance and behaviour of zombie de…

2019-10-14 Thread GitBox
codecov-io edited a comment on issue #5908: Revert "[AIRFLOW-4797] Improve performance and behaviour of zombie de… URL: https://github.com/apache/airflow/pull/5908#issuecomment-541951179 # [Codecov](https://codecov.io/gh/apache/airflow/pull/5908?src=pr=h1) Report > Merging

[GitHub] [airflow] codecov-io edited a comment on issue #5908: Revert "[AIRFLOW-4797] Improve performance and behaviour of zombie de…

2019-10-14 Thread GitBox
codecov-io edited a comment on issue #5908: Revert "[AIRFLOW-4797] Improve performance and behaviour of zombie de… URL: https://github.com/apache/airflow/pull/5908#issuecomment-541951179 # [Codecov](https://codecov.io/gh/apache/airflow/pull/5908?src=pr=h1) Report > Merging

[GitHub] [airflow] enricapq commented on a change in pull request #6327: [AIRFLOW-4675] Make airflow/lineage Pylint compatible

2019-10-14 Thread GitBox
enricapq commented on a change in pull request #6327: [AIRFLOW-4675] Make airflow/lineage Pylint compatible URL: https://github.com/apache/airflow/pull/6327#discussion_r334694263 ## File path: airflow/lineage/backend/atlas/__init__.py ## @@ -35,8 +36,9 @@ class

[GitHub] [airflow] codecov-io edited a comment on issue #6327: [AIRFLOW-4675] Make airflow/lineage Pylint compatible

2019-10-14 Thread GitBox
codecov-io edited a comment on issue #6327: [AIRFLOW-4675] Make airflow/lineage Pylint compatible URL: https://github.com/apache/airflow/pull/6327#issuecomment-541989032 # [Codecov](https://codecov.io/gh/apache/airflow/pull/6327?src=pr=h1) Report > Merging

[GitHub] [airflow] codecov-io commented on issue #6327: [AIRFLOW-4675] Make airflow/lineage Pylint compatible

2019-10-14 Thread GitBox
codecov-io commented on issue #6327: [AIRFLOW-4675] Make airflow/lineage Pylint compatible URL: https://github.com/apache/airflow/pull/6327#issuecomment-541989032 # [Codecov](https://codecov.io/gh/apache/airflow/pull/6327?src=pr=h1) Report > Merging

[GitHub] [airflow] kaxil commented on issue #6302: [AIRFLOW-5636] Allow adding or overriding existing Operator Links for…

2019-10-14 Thread GitBox
kaxil commented on issue #6302: [AIRFLOW-5636] Allow adding or overriding existing Operator Links for… URL: https://github.com/apache/airflow/pull/6302#issuecomment-541981038 Tests passes: https://travis-ci.org/kaxil/airflow/builds/597860562

[GitHub] [airflow] ashb commented on a change in pull request #6315: [AIRFLOW-5640] fix get_email_address_list types

2019-10-14 Thread GitBox
ashb commented on a change in pull request #6315: [AIRFLOW-5640] fix get_email_address_list types URL: https://github.com/apache/airflow/pull/6315#discussion_r334658113 ## File path: airflow/utils/email.py ## @@ -120,13 +122,22 @@ def send_MIME_email(e_from, e_to,

[GitHub] [airflow] ToxaZ commented on a change in pull request #5913: [AIRFLOW-5073] Change SQLSensor to treat NULL failure

2019-10-14 Thread GitBox
ToxaZ commented on a change in pull request #5913: [AIRFLOW-5073] Change SQLSensor to treat NULL failure URL: https://github.com/apache/airflow/pull/5913#discussion_r334652955 ## File path: airflow/sensors/sql_sensor.py ## @@ -102,6 +98,4 @@ def poke(self, context):

[GitHub] [airflow] KevinYang21 commented on issue #5908: Revert "[AIRFLOW-4797] Improve performance and behaviour of zombie de…

2019-10-14 Thread GitBox
KevinYang21 commented on issue #5908: Revert "[AIRFLOW-4797] Improve performance and behaviour of zombie de… URL: https://github.com/apache/airflow/pull/5908#issuecomment-541946593 @ashb ya that's my plan ;) This is an

[GitHub] [airflow] Sinsin1367 commented on issue #6261: [AIRFLOW-5141] Added optional resource usage logging to KubernetesPod…

2019-10-14 Thread GitBox
Sinsin1367 commented on issue #6261: [AIRFLOW-5141] Added optional resource usage logging to KubernetesPod… URL: https://github.com/apache/airflow/pull/6261#issuecomment-541952027 Just wanted to add: This change is integ tested using minikube locally and all integ tests were

[jira] [Commented] (AIRFLOW-4797) Zombie detection and killing is not deterministic

2019-10-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-4797?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16951389#comment-16951389 ] ASF GitHub Bot commented on AIRFLOW-4797: - KevinYang21 commented on pull request #5908: Revert

[jira] [Commented] (AIRFLOW-4797) Zombie detection and killing is not deterministic

2019-10-14 Thread ASF subversion and git services (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-4797?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16951391#comment-16951391 ] ASF subversion and git services commented on AIRFLOW-4797: -- Commit

[jira] [Commented] (AIRFLOW-4797) Zombie detection and killing is not deterministic

2019-10-14 Thread ASF subversion and git services (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-4797?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16951390#comment-16951390 ] ASF subversion and git services commented on AIRFLOW-4797: -- Commit

[GitHub] [airflow] KevinYang21 merged pull request #5908: Revert "[AIRFLOW-4797] Improve performance and behaviour of zombie de…

2019-10-14 Thread GitBox
KevinYang21 merged pull request #5908: Revert "[AIRFLOW-4797] Improve performance and behaviour of zombie de… URL: https://github.com/apache/airflow/pull/5908 This is an automated message from the Apache Git Service. To

[GitHub] [airflow] ashb commented on a change in pull request #5913: [AIRFLOW-5073] Change SQLSensor to treat NULL failure

2019-10-14 Thread GitBox
ashb commented on a change in pull request #5913: [AIRFLOW-5073] Change SQLSensor to treat NULL failure URL: https://github.com/apache/airflow/pull/5913#discussion_r334656308 ## File path: airflow/sensors/sql_sensor.py ## @@ -102,6 +98,4 @@ def poke(self, context):

[GitHub] [airflow] codecov-io commented on issue #6334: [AIRFLOW-5657] Update the upper bound for dill

2019-10-14 Thread GitBox
codecov-io commented on issue #6334: [AIRFLOW-5657] Update the upper bound for dill URL: https://github.com/apache/airflow/pull/6334#issuecomment-541912646 # [Codecov](https://codecov.io/gh/apache/airflow/pull/6334?src=pr=h1) Report > Merging

[GitHub] [airflow] codecov-io edited a comment on issue #6302: [AIRFLOW-5636] Allow adding or overriding existing Operator Links for…

2019-10-14 Thread GitBox
codecov-io edited a comment on issue #6302: [AIRFLOW-5636] Allow adding or overriding existing Operator Links for… URL: https://github.com/apache/airflow/pull/6302#issuecomment-540867241 # [Codecov](https://codecov.io/gh/apache/airflow/pull/6302?src=pr=h1) Report > Merging

[GitHub] [airflow] codecov-io edited a comment on issue #5743: [AIRFLOW-5088][AIP-24] Persisting serialized DAG in DB for webserver scalability

2019-10-14 Thread GitBox
codecov-io edited a comment on issue #5743: [AIRFLOW-5088][AIP-24] Persisting serialized DAG in DB for webserver scalability URL: https://github.com/apache/airflow/pull/5743#issuecomment-529755241 # [Codecov](https://codecov.io/gh/apache/airflow/pull/5743?src=pr=h1) Report > Merging

[jira] [Updated] (AIRFLOW-5648) Add ClearTaskOperator to allow clearing/re-running tasks from within a DAG

2019-10-14 Thread Qian Yu (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5648?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qian Yu updated AIRFLOW-5648: - Description: There are use cases where some external conditions have changed and a section of the DAG

[jira] [Updated] (AIRFLOW-5648) Add ClearTaskOperator to allow clearing/re-running tasks from within a DAG

2019-10-14 Thread Qian Yu (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5648?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qian Yu updated AIRFLOW-5648: - Description: There are use cases where some external conditions have changed and a section of the DAG

[jira] [Closed] (AIRFLOW-5653) Log caught AirflowSkipException in task instance log

2019-10-14 Thread Rajat Srivastava (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5653?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajat Srivastava closed AIRFLOW-5653. - > Log caught AirflowSkipException in task instance log >

[jira] [Resolved] (AIRFLOW-5653) Log caught AirflowSkipException in task instance log

2019-10-14 Thread Rajat Srivastava (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5653?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajat Srivastava resolved AIRFLOW-5653. --- Fix Version/s: 1.10.6 Resolution: Fixed Added logging for AirflowSkip

[GitHub] [airflow] houqp commented on a change in pull request #6312: [AIRFLOW-5641] support running git sync container as root

2019-10-14 Thread GitBox
houqp commented on a change in pull request #6312: [AIRFLOW-5641] support running git sync container as root URL: https://github.com/apache/airflow/pull/6312#discussion_r334724676 ## File path: airflow/kubernetes/worker_configuration.py ## @@ -154,7 +154,7 @@ def

[GitHub] [airflow] houqp commented on issue #6312: [AIRFLOW-5641] support running git sync container as root

2019-10-14 Thread GitBox
houqp commented on issue #6312: [AIRFLOW-5641] support running git sync container as root URL: https://github.com/apache/airflow/pull/6312#issuecomment-542001777 Turns out I was setting gi_sync_run_as_user to None, which was causing the crash. I have added a test case to avoid setting

[GitHub] [airflow] codecov-io edited a comment on issue #6327: [AIRFLOW-4675] Make airflow/lineage Pylint compatible

2019-10-14 Thread GitBox
codecov-io edited a comment on issue #6327: [AIRFLOW-4675] Make airflow/lineage Pylint compatible URL: https://github.com/apache/airflow/pull/6327#issuecomment-541989032 # [Codecov](https://codecov.io/gh/apache/airflow/pull/6327?src=pr=h1) Report > Merging

[GitHub] [airflow] codecov-io commented on issue #6326: [AIRFLOW-5652] Add provider package to lint rules

2019-10-14 Thread GitBox
codecov-io commented on issue #6326: [AIRFLOW-5652] Add provider package to lint rules URL: https://github.com/apache/airflow/pull/6326#issuecomment-541579715 # [Codecov](https://codecov.io/gh/apache/airflow/pull/6326?src=pr=h1) Report > Merging

[GitHub] [airflow] ashb commented on a change in pull request #6303: AIRFLOW-5126 Read aws_session_token in extra_config of the aws hook

2019-10-14 Thread GitBox
ashb commented on a change in pull request #6303: AIRFLOW-5126 Read aws_session_token in extra_config of the aws hook URL: https://github.com/apache/airflow/pull/6303#discussion_r334396758 ## File path: airflow/contrib/hooks/aws_hook.py ## @@ -111,6 +111,8 @@ def

[GitHub] [airflow] ashb commented on a change in pull request #6090: [AIRFLOW-5470] Add Apache Livy REST operator

2019-10-14 Thread GitBox
ashb commented on a change in pull request #6090: [AIRFLOW-5470] Add Apache Livy REST operator URL: https://github.com/apache/airflow/pull/6090#discussion_r334407530 ## File path: airflow/contrib/operators/livy_operator.py ## @@ -0,0 +1,178 @@ +# -*- coding: utf-8 -*- +#

[GitHub] [airflow] michalslowikowski00 commented on a change in pull request #6306: [AIRFLOW-5632] Rename ComputeEngine operators

2019-10-14 Thread GitBox
michalslowikowski00 commented on a change in pull request #6306: [AIRFLOW-5632] Rename ComputeEngine operators URL: https://github.com/apache/airflow/pull/6306#discussion_r334427298 ## File path: tests/test_core_to_contrib.py ## @@ -16,787 +16,814 @@ # KIND, either

[GitHub] [airflow] michalslowikowski00 commented on a change in pull request #6306: [AIRFLOW-5632] Rename ComputeEngine operators

2019-10-14 Thread GitBox
michalslowikowski00 commented on a change in pull request #6306: [AIRFLOW-5632] Rename ComputeEngine operators URL: https://github.com/apache/airflow/pull/6306#discussion_r334428567 ## File path: UPDATING.md ## @@ -163,7 +163,7 @@ The following table shows changes in

[GitHub] [airflow] ashb commented on a change in pull request #6330: AIRFLOW-5653 Log caught AirflowSkipException in task instance log

2019-10-14 Thread GitBox
ashb commented on a change in pull request #6330: AIRFLOW-5653 Log caught AirflowSkipException in task instance log URL: https://github.com/apache/airflow/pull/6330#discussion_r334439416 ## File path: airflow/models/taskinstance.py ## @@ -950,7 +950,10 @@ def

[GitHub] [airflow] ashb commented on a change in pull request #5743: [AIRFLOW-5088][AIP-24] Persisting serialized DAG in DB for webserver scalability

2019-10-14 Thread GitBox
ashb commented on a change in pull request #5743: [AIRFLOW-5088][AIP-24] Persisting serialized DAG in DB for webserver scalability URL: https://github.com/apache/airflow/pull/5743#discussion_r334438983 ## File path: airflow/dag/serialization/schema.json ## @@ -0,0 +1,196

[GitHub] [airflow] codecov-io commented on issue #6308: [AIRFLOW-5634] Don't allow editing of DagModelView

2019-10-14 Thread GitBox
codecov-io commented on issue #6308: [AIRFLOW-5634] Don't allow editing of DagModelView URL: https://github.com/apache/airflow/pull/6308#issuecomment-541615771 # [Codecov](https://codecov.io/gh/apache/airflow/pull/6308?src=pr=h1) Report > :exclamation: No coverage uploaded for pull

[GitHub] [airflow] rajatsri28 opened a new pull request #6330: AIRFLOW-5653 Log caught AirflowSkipException in task instance log

2019-10-14 Thread GitBox
rajatsri28 opened a new pull request #6330: AIRFLOW-5653 Log caught AirflowSkipException in task instance log URL: https://github.com/apache/airflow/pull/6330 ### Jira - https://issues.apache.org/jira/browse/AIRFLOW-5653 ### Description - Logging any caught

[jira] [Commented] (AIRFLOW-5653) Log caught AirflowSkipException in task instance log

2019-10-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5653?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16950928#comment-16950928 ] ASF GitHub Bot commented on AIRFLOW-5653: - rajatsri28 commented on pull request #6330:

[jira] [Commented] (AIRFLOW-4965) Handling throttling in GCP AI operators

2019-10-14 Thread ASF subversion and git services (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-4965?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16950945#comment-16950945 ] ASF subversion and git services commented on AIRFLOW-4965: -- Commit

[jira] [Commented] (AIRFLOW-4309) Delete dag doesn't delete everything

2019-10-14 Thread ASF subversion and git services (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-4309?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16950942#comment-16950942 ] ASF subversion and git services commented on AIRFLOW-4309: -- Commit

[jira] [Commented] (AIRFLOW-5481) Allow Deleting Renamed DAGs

2019-10-14 Thread ASF subversion and git services (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16950943#comment-16950943 ] ASF subversion and git services commented on AIRFLOW-5481: -- Commit

[jira] [Commented] (AIRFLOW-5634) Disabled DagModelView fields can be edited (classic UI)

2019-10-14 Thread ASF subversion and git services (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5634?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16950947#comment-16950947 ] ASF subversion and git services commented on AIRFLOW-5634: -- Commit

[jira] [Commented] (AIRFLOW-5588) Add celery's architecture diagram

2019-10-14 Thread ASF subversion and git services (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16950941#comment-16950941 ] ASF subversion and git services commented on AIRFLOW-5588: -- Commit

[jira] [Commented] (AIRFLOW-3783) Switch to HEADER arg to unload data from Redshift to S3

2019-10-14 Thread ASF subversion and git services (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-3783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16950944#comment-16950944 ] ASF subversion and git services commented on AIRFLOW-3783: -- Commit

[jira] [Commented] (AIRFLOW-4741) Include Sentry for Error Tracking in Core functionality

2019-10-14 Thread ASF subversion and git services (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-4741?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16950937#comment-16950937 ] ASF subversion and git services commented on AIRFLOW-4741: -- Commit

[jira] [Commented] (AIRFLOW-4965) Handling throttling in GCP AI operators

2019-10-14 Thread ASF subversion and git services (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-4965?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16950946#comment-16950946 ] ASF subversion and git services commented on AIRFLOW-4965: -- Commit

[jira] [Commented] (AIRFLOW-5387) Pagination is broken when the config variable hide_paused_dags_by_default is set to True because showPaused variable is removed

2019-10-14 Thread ASF subversion and git services (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5387?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16950935#comment-16950935 ] ASF subversion and git services commented on AIRFLOW-5387: -- Commit

[jira] [Resolved] (AIRFLOW-5634) Disabled DagModelView fields can be edited (classic UI)

2019-10-14 Thread Ash Berlin-Taylor (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5634?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ash Berlin-Taylor resolved AIRFLOW-5634. Resolution: Fixed > Disabled DagModelView fields can be edited (classic UI) >

[jira] [Commented] (AIRFLOW-5588) Add celery's architecture diagram

2019-10-14 Thread ASF subversion and git services (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16950940#comment-16950940 ] ASF subversion and git services commented on AIRFLOW-5588: -- Commit

[jira] [Commented] (AIRFLOW-5481) Allow Deleting Renamed DAGs

2019-10-14 Thread ASF subversion and git services (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16950936#comment-16950936 ] ASF subversion and git services commented on AIRFLOW-5481: -- Commit

[GitHub] [airflow] ashb commented on a change in pull request #6090: [AIRFLOW-5470] Add Apache Livy REST operator

2019-10-14 Thread GitBox
ashb commented on a change in pull request #6090: [AIRFLOW-5470] Add Apache Livy REST operator URL: https://github.com/apache/airflow/pull/6090#discussion_r334400116 ## File path: airflow/contrib/operators/livy_operator.py ## @@ -0,0 +1,178 @@ +# -*- coding: utf-8 -*- +#

[GitHub] [airflow] ashb commented on a change in pull request #6090: [AIRFLOW-5470] Add Apache Livy REST operator

2019-10-14 Thread GitBox
ashb commented on a change in pull request #6090: [AIRFLOW-5470] Add Apache Livy REST operator URL: https://github.com/apache/airflow/pull/6090#discussion_r334406839 ## File path: tests/contrib/operators/test_livy_operator.py ## @@ -0,0 +1,156 @@ +# -*- coding: utf-8 -*-

[GitHub] [airflow] ashb commented on a change in pull request #6090: [AIRFLOW-5470] Add Apache Livy REST operator

2019-10-14 Thread GitBox
ashb commented on a change in pull request #6090: [AIRFLOW-5470] Add Apache Livy REST operator URL: https://github.com/apache/airflow/pull/6090#discussion_r334399646 ## File path: airflow/contrib/operators/livy_operator.py ## @@ -0,0 +1,178 @@ +# -*- coding: utf-8 -*- +#

[GitHub] [airflow] ashb commented on a change in pull request #6090: [AIRFLOW-5470] Add Apache Livy REST operator

2019-10-14 Thread GitBox
ashb commented on a change in pull request #6090: [AIRFLOW-5470] Add Apache Livy REST operator URL: https://github.com/apache/airflow/pull/6090#discussion_r334401152 ## File path: airflow/contrib/sensors/livy_sensor.py ## @@ -0,0 +1,61 @@ +# -*- coding: utf-8 -*- +# +#

[GitHub] [airflow] ashb commented on a change in pull request #6090: [AIRFLOW-5470] Add Apache Livy REST operator

2019-10-14 Thread GitBox
ashb commented on a change in pull request #6090: [AIRFLOW-5470] Add Apache Livy REST operator URL: https://github.com/apache/airflow/pull/6090#discussion_r334401731 ## File path: airflow/contrib/sensors/livy_sensor.py ## @@ -0,0 +1,61 @@ +# -*- coding: utf-8 -*- +# +#

[GitHub] [airflow] ashb commented on a change in pull request #6090: [AIRFLOW-5470] Add Apache Livy REST operator

2019-10-14 Thread GitBox
ashb commented on a change in pull request #6090: [AIRFLOW-5470] Add Apache Livy REST operator URL: https://github.com/apache/airflow/pull/6090#discussion_r334403219 ## File path: airflow/contrib/sensors/livy_sensor.py ## @@ -0,0 +1,61 @@ +# -*- coding: utf-8 -*- +# +#

[GitHub] [airflow] ashb commented on a change in pull request #6090: [AIRFLOW-5470] Add Apache Livy REST operator

2019-10-14 Thread GitBox
ashb commented on a change in pull request #6090: [AIRFLOW-5470] Add Apache Livy REST operator URL: https://github.com/apache/airflow/pull/6090#discussion_r334399249 ## File path: airflow/contrib/operators/livy_operator.py ## @@ -0,0 +1,178 @@ +# -*- coding: utf-8 -*- +#

[GitHub] [airflow] ashb commented on a change in pull request #6090: [AIRFLOW-5470] Add Apache Livy REST operator

2019-10-14 Thread GitBox
ashb commented on a change in pull request #6090: [AIRFLOW-5470] Add Apache Livy REST operator URL: https://github.com/apache/airflow/pull/6090#discussion_r334401651 ## File path: airflow/contrib/sensors/livy_sensor.py ## @@ -0,0 +1,61 @@ +# -*- coding: utf-8 -*- +# +#

[GitHub] [airflow] ashb commented on a change in pull request #6090: [AIRFLOW-5470] Add Apache Livy REST operator

2019-10-14 Thread GitBox
ashb commented on a change in pull request #6090: [AIRFLOW-5470] Add Apache Livy REST operator URL: https://github.com/apache/airflow/pull/6090#discussion_r334399151 ## File path: airflow/contrib/operators/livy_operator.py ## @@ -0,0 +1,178 @@ +# -*- coding: utf-8 -*- +#

[GitHub] [airflow] ashb commented on a change in pull request #6090: [AIRFLOW-5470] Add Apache Livy REST operator

2019-10-14 Thread GitBox
ashb commented on a change in pull request #6090: [AIRFLOW-5470] Add Apache Livy REST operator URL: https://github.com/apache/airflow/pull/6090#discussion_r334402613 ## File path: airflow/contrib/operators/livy_operator.py ## @@ -0,0 +1,178 @@ +# -*- coding: utf-8 -*- +#

[GitHub] [airflow] ashb commented on a change in pull request #6090: [AIRFLOW-5470] Add Apache Livy REST operator

2019-10-14 Thread GitBox
ashb commented on a change in pull request #6090: [AIRFLOW-5470] Add Apache Livy REST operator URL: https://github.com/apache/airflow/pull/6090#discussion_r334398035 ## File path: airflow/contrib/example_dags/example_livy_operator.py ## @@ -0,0 +1,63 @@ +# -*- coding:

[jira] [Updated] (AIRFLOW-5653) Log caught AirflowSkipException in task instance log

2019-10-14 Thread Rajat Srivastava (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5653?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajat Srivastava updated AIRFLOW-5653: -- Component/s: (was: operators) Summary: Log caught AirflowSkipException in

[GitHub] [airflow] potiuk merged pull request #6329: [AIRFLOW-XXX] Fixed case problem with CONTRIBUTING.rst

2019-10-14 Thread GitBox
potiuk merged pull request #6329: [AIRFLOW-XXX] Fixed case problem with CONTRIBUTING.rst URL: https://github.com/apache/airflow/pull/6329 This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [airflow] michalslowikowski00 commented on a change in pull request #6306: [AIRFLOW-5632] Rename ComputeEngine operators

2019-10-14 Thread GitBox
michalslowikowski00 commented on a change in pull request #6306: [AIRFLOW-5632] Rename ComputeEngine operators URL: https://github.com/apache/airflow/pull/6306#discussion_r334425667 ## File path: tests/gcp/hooks/test_gcp_compute_hook.py ## @@ -67,16 +67,15 @@ def

[GitHub] [airflow] ashb merged pull request #6308: [AIRFLOW-5634] Don't allow editing of DagModelView

2019-10-14 Thread GitBox
ashb merged pull request #6308: [AIRFLOW-5634] Don't allow editing of DagModelView URL: https://github.com/apache/airflow/pull/6308 This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [airflow] ashb commented on a change in pull request #6308: [AIRFLOW-5634] Don't allow editing of DagModelView

2019-10-14 Thread GitBox
ashb commented on a change in pull request #6308: [AIRFLOW-5634] Don't allow editing of DagModelView URL: https://github.com/apache/airflow/pull/6308#discussion_r334397669 ## File path: tests/www/test_views.py ## @@ -446,10 +446,6 @@ def test_xcom(self): resp =

[GitHub] [airflow] ashb commented on a change in pull request #6090: [AIRFLOW-5470] Add Apache Livy REST operator

2019-10-14 Thread GitBox
ashb commented on a change in pull request #6090: [AIRFLOW-5470] Add Apache Livy REST operator URL: https://github.com/apache/airflow/pull/6090#discussion_r334402110 ## File path: airflow/contrib/operators/livy_operator.py ## @@ -0,0 +1,178 @@ +# -*- coding: utf-8 -*- +#

[GitHub] [airflow] ashb commented on a change in pull request #6090: [AIRFLOW-5470] Add Apache Livy REST operator

2019-10-14 Thread GitBox
ashb commented on a change in pull request #6090: [AIRFLOW-5470] Add Apache Livy REST operator URL: https://github.com/apache/airflow/pull/6090#discussion_r334400615 ## File path: airflow/contrib/operators/livy_operator.py ## @@ -0,0 +1,178 @@ +# -*- coding: utf-8 -*- +#

[GitHub] [airflow] ashb commented on a change in pull request #6090: [AIRFLOW-5470] Add Apache Livy REST operator

2019-10-14 Thread GitBox
ashb commented on a change in pull request #6090: [AIRFLOW-5470] Add Apache Livy REST operator URL: https://github.com/apache/airflow/pull/6090#discussion_r334405669 ## File path: tests/contrib/hooks/test_livy_hook.py ## @@ -0,0 +1,414 @@ +# -*- coding: utf-8 -*- +# +#

[jira] [Commented] (AIRFLOW-5639) DagFileProcessor: parse dag files every time, which consume lots of resources and is unnecessary

2019-10-14 Thread Ash Berlin-Taylor (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5639?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16950888#comment-16950888 ] Ash Berlin-Taylor commented on AIRFLOW-5639: As you say, right now we need to do this, but

[GitHub] [airflow] mik-laj commented on a change in pull request #5743: [AIRFLOW-5088][AIP-24] Persisting serialized DAG in DB for webserver scalability

2019-10-14 Thread GitBox
mik-laj commented on a change in pull request #5743: [AIRFLOW-5088][AIP-24] Persisting serialized DAG in DB for webserver scalability URL: https://github.com/apache/airflow/pull/5743#discussion_r334419161 ## File path: airflow/dag/serialization/schema.json ## @@ -0,0

[GitHub] [airflow] michalslowikowski00 commented on a change in pull request #6306: [AIRFLOW-5632] Rename ComputeEngine operators

2019-10-14 Thread GitBox
michalslowikowski00 commented on a change in pull request #6306: [AIRFLOW-5632] Rename ComputeEngine operators URL: https://github.com/apache/airflow/pull/6306#discussion_r334420592 ## File path: airflow/contrib/hooks/gcp_compute_hook.py ## @@ -16,14 +16,30 @@ # KIND,

[GitHub] [airflow] michalslowikowski00 commented on a change in pull request #6306: [AIRFLOW-5632] Rename ComputeEngine operators

2019-10-14 Thread GitBox
michalslowikowski00 commented on a change in pull request #6306: [AIRFLOW-5632] Rename ComputeEngine operators URL: https://github.com/apache/airflow/pull/6306#discussion_r334420552 ## File path: airflow/contrib/hooks/gcp_compute_hook.py ## @@ -16,14 +16,30 @@ # KIND,

[GitHub] [airflow] michalslowikowski00 commented on a change in pull request #6306: [AIRFLOW-5632] Rename ComputeEngine operators

2019-10-14 Thread GitBox
michalslowikowski00 commented on a change in pull request #6306: [AIRFLOW-5632] Rename ComputeEngine operators URL: https://github.com/apache/airflow/pull/6306#discussion_r334420626 ## File path: airflow/contrib/hooks/gcp_compute_hook.py ## @@ -16,14 +16,30 @@ # KIND,

[GitHub] [airflow] michalslowikowski00 commented on a change in pull request #6306: [AIRFLOW-5632] Rename ComputeEngine operators

2019-10-14 Thread GitBox
michalslowikowski00 commented on a change in pull request #6306: [AIRFLOW-5632] Rename ComputeEngine operators URL: https://github.com/apache/airflow/pull/6306#discussion_r334420670 ## File path: airflow/contrib/hooks/gcp_compute_hook.py ## @@ -16,14 +16,30 @@ # KIND,

[jira] [Work started] (AIRFLOW-5653) Logging airflow operator raised exceptions

2019-10-14 Thread Rajat Srivastava (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5653?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on AIRFLOW-5653 started by Rajat Srivastava. - > Logging airflow operator raised exceptions >

[GitHub] [airflow] potiuk merged pull request #6328: [AIRFLOW-5650] remove githubhandle

2019-10-14 Thread GitBox
potiuk merged pull request #6328: [AIRFLOW-5650] remove githubhandle URL: https://github.com/apache/airflow/pull/6328 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[jira] [Commented] (AIRFLOW-5650) Add GSN Games into officially using airflow list in README.md

2019-10-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16950816#comment-16950816 ] ASF GitHub Bot commented on AIRFLOW-5650: - potiuk commented on pull request #6328:

[GitHub] [airflow] potiuk merged pull request #6325: [AIRFLOW-5651] Replace GCP deprecated imports

2019-10-14 Thread GitBox
potiuk merged pull request #6325: [AIRFLOW-5651] Replace GCP deprecated imports URL: https://github.com/apache/airflow/pull/6325 This is an automated message from the Apache Git Service. To respond to the message, please log

[jira] [Commented] (AIRFLOW-5626) Add labels to MLEngine resources

2019-10-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5626?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16950814#comment-16950814 ] ASF GitHub Bot commented on AIRFLOW-5626: - potiuk commented on pull request #6296:

[jira] [Commented] (AIRFLOW-5626) Add labels to MLEngine resources

2019-10-14 Thread ASF subversion and git services (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5626?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16950815#comment-16950815 ] ASF subversion and git services commented on AIRFLOW-5626: -- Commit

[jira] [Commented] (AIRFLOW-3783) Switch to HEADER arg to unload data from Redshift to S3

2019-10-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-3783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16950827#comment-16950827 ] ASF GitHub Bot commented on AIRFLOW-3783: - ashb commented on pull request #6309:

[GitHub] [airflow] ashb merged pull request #6309: [AIRFLOW-3783][AIRFLOW-5395] Switch to HEADER arg to unload data from Redshift to S3

2019-10-14 Thread GitBox
ashb merged pull request #6309: [AIRFLOW-3783][AIRFLOW-5395] Switch to HEADER arg to unload data from Redshift to S3 URL: https://github.com/apache/airflow/pull/6309 This is an automated message from the Apache Git Service.

[jira] [Resolved] (AIRFLOW-3783) Switch to HEADER arg to unload data from Redshift to S3

2019-10-14 Thread Ash Berlin-Taylor (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-3783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ash Berlin-Taylor resolved AIRFLOW-3783. Fix Version/s: 1.10.6 Resolution: Fixed > Switch to HEADER arg to unload

[jira] [Created] (AIRFLOW-5653) Logging airflow operator raised exceptions

2019-10-14 Thread Rajat Srivastava (Jira)
Rajat Srivastava created AIRFLOW-5653: - Summary: Logging airflow operator raised exceptions Key: AIRFLOW-5653 URL: https://issues.apache.org/jira/browse/AIRFLOW-5653 Project: Apache Airflow

[GitHub] [airflow] mik-laj commented on a change in pull request #5743: [AIRFLOW-5088][AIP-24] Persisting serialized DAG in DB for webserver scalability

2019-10-14 Thread GitBox
mik-laj commented on a change in pull request #5743: [AIRFLOW-5088][AIP-24] Persisting serialized DAG in DB for webserver scalability URL: https://github.com/apache/airflow/pull/5743#discussion_r334340613 ## File path: airflow/dag/serialization/schema.json ## @@ -0,0

[GitHub] [airflow] codecov-io edited a comment on issue #6285: [AIRFLOW-XXX] Updates to Breeze documentation from GSOD

2019-10-14 Thread GitBox
codecov-io edited a comment on issue #6285: [AIRFLOW-XXX] Updates to Breeze documentation from GSOD URL: https://github.com/apache/airflow/pull/6285#issuecomment-539536232 # [Codecov](https://codecov.io/gh/apache/airflow/pull/6285?src=pr=h1) Report > Merging

[GitHub] [airflow] potiuk opened a new pull request #6329: [AIRFLOW-XXX] Fixed case problem with CONTRIBUTING.rst

2019-10-14 Thread GitBox
potiuk opened a new pull request #6329: [AIRFLOW-XXX] Fixed case problem with CONTRIBUTING.rst URL: https://github.com/apache/airflow/pull/6329 Make sure you have checked _all_ steps below. ### Jira - [x] My PR addresses the following [Airflow

[GitHub] [airflow] potiuk commented on a change in pull request #6285: [AIRFLOW-XXX] Updates to Breeze documentation from GSOD

2019-10-14 Thread GitBox
potiuk commented on a change in pull request #6285: [AIRFLOW-XXX] Updates to Breeze documentation from GSOD URL: https://github.com/apache/airflow/pull/6285#discussion_r334344126 ## File path: BREEZE.rst ## @@ -290,165 +264,170 @@ It is as easy as copy this line into your

[GitHub] [airflow] potiuk commented on issue #6285: [AIRFLOW-XXX] Updates to Breeze documentation from GSOD

2019-10-14 Thread GitBox
potiuk commented on issue #6285: [AIRFLOW-XXX] Updates to Breeze documentation from GSOD URL: https://github.com/apache/airflow/pull/6285#issuecomment-541524442 Let me know when you think the PR is ready @efedotova - I will mark it as ready for review and loop-in other community members

[GitHub] [airflow] codecov-io edited a comment on issue #6285: [AIRFLOW-XXX] Updates to Breeze documentation from GSOD

2019-10-14 Thread GitBox
codecov-io edited a comment on issue #6285: [AIRFLOW-XXX] Updates to Breeze documentation from GSOD URL: https://github.com/apache/airflow/pull/6285#issuecomment-539536232 # [Codecov](https://codecov.io/gh/apache/airflow/pull/6285?src=pr=h1) Report > Merging

[GitHub] [airflow] jojo19893 commented on issue #6303: AIRFLOW-5126 Read aws_session_token in extra_config of the aws hook

2019-10-14 Thread GitBox
jojo19893 commented on issue #6303: AIRFLOW-5126 Read aws_session_token in extra_config of the aws hook URL: https://github.com/apache/airflow/pull/6303#issuecomment-541534427 OKay @ashb I changed that and left it as implemented in the original does that work?

[GitHub] [airflow] codecov-io commented on issue #6329: [AIRFLOW-XXX] Fixed case problem with CONTRIBUTING.rst

2019-10-14 Thread GitBox
codecov-io commented on issue #6329: [AIRFLOW-XXX] Fixed case problem with CONTRIBUTING.rst URL: https://github.com/apache/airflow/pull/6329#issuecomment-541540725 # [Codecov](https://codecov.io/gh/apache/airflow/pull/6329?src=pr=h1) Report > Merging

  1   2   3   >