[jira] [Created] (AIRFLOW-5658) Links issue through reverse proxy access

2019-10-15 Thread Jira
Mikołaj Morawski created AIRFLOW-5658: - Summary: Links issue through reverse proxy access Key: AIRFLOW-5658 URL: https://issues.apache.org/jira/browse/AIRFLOW-5658 Project: Apache Airflow

[jira] [Updated] (AIRFLOW-5658) Links issue through reverse proxy access

2019-10-15 Thread Jira
[ https://issues.apache.org/jira/browse/AIRFLOW-5658?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mikołaj Morawski updated AIRFLOW-5658: -- Attachment: image-2019-10-15-16-02-45-731.png Description: The access through a

[jira] [Updated] (AIRFLOW-5658) Links issue through reverse proxy access

2019-10-15 Thread Jira
[ https://issues.apache.org/jira/browse/AIRFLOW-5658?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mikołaj Morawski updated AIRFLOW-5658: -- Description: The access through a reverse proxy is not working for the following two

[jira] [Commented] (AIRFLOW-5636) Allow adding or overriding existing Extra Operator Links for existing Operators

2019-10-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5636?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16951953#comment-16951953 ] ASF GitHub Bot commented on AIRFLOW-5636: - kaxil commented on pull request #6302:

[GitHub] [airflow] kaxil merged pull request #6302: [AIRFLOW-5636] Allow adding or overriding existing Operator Links for…

2019-10-15 Thread GitBox
kaxil merged pull request #6302: [AIRFLOW-5636] Allow adding or overriding existing Operator Links for… URL: https://github.com/apache/airflow/pull/6302 This is an automated message from the Apache Git Service. To respond

[jira] [Resolved] (AIRFLOW-5636) Allow adding or overriding existing Extra Operator Links for existing Operators

2019-10-15 Thread Kaxil Naik (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5636?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kaxil Naik resolved AIRFLOW-5636. - Resolution: Fixed > Allow adding or overriding existing Extra Operator Links for existing >

[jira] [Commented] (AIRFLOW-5636) Allow adding or overriding existing Extra Operator Links for existing Operators

2019-10-15 Thread ASF subversion and git services (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5636?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16951954#comment-16951954 ] ASF subversion and git services commented on AIRFLOW-5636: -- Commit

[jira] [Updated] (AIRFLOW-5636) Allow adding or overriding existing Extra Operator Links for existing Operators

2019-10-15 Thread Kaxil Naik (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5636?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kaxil Naik updated AIRFLOW-5636: Fix Version/s: (was: 2.0.0) > Allow adding or overriding existing Extra Operator Links for

[jira] [Created] (AIRFLOW-5659) Add support for ephemeral storage on KubernetesPodOperator

2019-10-15 Thread Leonardo Miguel (Jira)
Leonardo Miguel created AIRFLOW-5659: Summary: Add support for ephemeral storage on KubernetesPodOperator Key: AIRFLOW-5659 URL: https://issues.apache.org/jira/browse/AIRFLOW-5659 Project: Apache

[GitHub] [airflow] adityav commented on a change in pull request #6340: [Airflow-5660] Try to find the task in DB before regressing to search…

2019-10-15 Thread GitBox
adityav commented on a change in pull request #6340: [Airflow-5660] Try to find the task in DB before regressing to search… URL: https://github.com/apache/airflow/pull/6340#discussion_r335107805 ## File path: airflow/executors/kubernetes_executor.py ## @@ -545,6 +545,26

[GitHub] [airflow] mik-laj commented on a change in pull request #5743: [AIRFLOW-5088][AIP-24] Persisting serialized DAG in DB for webserver scalability

2019-10-15 Thread GitBox
mik-laj commented on a change in pull request #5743: [AIRFLOW-5088][AIP-24] Persisting serialized DAG in DB for webserver scalability URL: https://github.com/apache/airflow/pull/5743#discussion_r335179058 ## File path: docs/howto/enable-dag-serialization.rst ## @@ -0,0

[GitHub] [airflow] mik-laj commented on a change in pull request #5743: [AIRFLOW-5088][AIP-24] Persisting serialized DAG in DB for webserver scalability

2019-10-15 Thread GitBox
mik-laj commented on a change in pull request #5743: [AIRFLOW-5088][AIP-24] Persisting serialized DAG in DB for webserver scalability URL: https://github.com/apache/airflow/pull/5743#discussion_r335179483 ## File path: docs/howto/enable-dag-serialization.rst ## @@ -0,0

[GitHub] [airflow] jaketf commented on issue #6210: [AIRFLOW-5567] BaseAsyncOperator

2019-10-15 Thread GitBox
jaketf commented on issue #6210: [AIRFLOW-5567] BaseAsyncOperator URL: https://github.com/apache/airflow/pull/6210#issuecomment-542428297 @potiuk I'd love to work on this further as I have time. I'd really like input on next steps: 1. I don't know how to fix the failing docs build.

[GitHub] [airflow] kaxil commented on issue #5743: [AIRFLOW-5088][AIP-24] Persisting serialized DAG in DB for webserver scalability

2019-10-15 Thread GitBox
kaxil commented on issue #5743: [AIRFLOW-5088][AIP-24] Persisting serialized DAG in DB for webserver scalability URL: https://github.com/apache/airflow/pull/5743#issuecomment-542431579 @mik-laj Agree with most of your comments, will update it by end of this week.

[GitHub] [airflow] houqp opened a new pull request #6342: [AIRFLOW-5662] fix incorrect naming for scheduler used slot metric

2019-10-15 Thread GitBox
houqp opened a new pull request #6342: [AIRFLOW-5662] fix incorrect naming for scheduler used slot metric URL: https://github.com/apache/airflow/pull/6342 Make sure you have checked _all_ steps below. ### Jira - [ ] My PR addresses the following [Airflow

[jira] [Commented] (AIRFLOW-5662) Scheduler incorrectly emits occupied slots count metric as used slot count

2019-10-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5662?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16952230#comment-16952230 ] ASF GitHub Bot commented on AIRFLOW-5662: - houqp commented on pull request #6342:

[GitHub] [airflow] SaturnFromTitan closed pull request #6320: [AIRFLOW-5623]: attempt to add a failing test

2019-10-15 Thread GitBox
SaturnFromTitan closed pull request #6320: [AIRFLOW-5623]: attempt to add a failing test URL: https://github.com/apache/airflow/pull/6320 This is an automated message from the Apache Git Service. To respond to the message,

[jira] [Commented] (AIRFLOW-5623) latest_only_operator fails for schedule_interval='@once'

2019-10-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16952246#comment-16952246 ] ASF GitHub Bot commented on AIRFLOW-5623: - SaturnFromTitan commented on pull request #6320:

[GitHub] [airflow] mik-laj commented on a change in pull request #5743: [AIRFLOW-5088][AIP-24] Persisting serialized DAG in DB for webserver scalability

2019-10-15 Thread GitBox
mik-laj commented on a change in pull request #5743: [AIRFLOW-5088][AIP-24] Persisting serialized DAG in DB for webserver scalability URL: https://github.com/apache/airflow/pull/5743#discussion_r335177865 ## File path: docs/howto/enable-dag-serialization.rst ## @@ -0,0

[GitHub] [airflow] mik-laj commented on a change in pull request #5743: [AIRFLOW-5088][AIP-24] Persisting serialized DAG in DB for webserver scalability

2019-10-15 Thread GitBox
mik-laj commented on a change in pull request #5743: [AIRFLOW-5088][AIP-24] Persisting serialized DAG in DB for webserver scalability URL: https://github.com/apache/airflow/pull/5743#discussion_r335181941 ## File path: docs/howto/enable-dag-serialization.rst ## @@ -0,0

[GitHub] [airflow] dstandish commented on issue #6210: [AIRFLOW-5567] BaseAsyncOperator

2019-10-15 Thread GitBox
dstandish commented on issue #6210: [AIRFLOW-5567] BaseAsyncOperator URL: https://github.com/apache/airflow/pull/6210#issuecomment-542409947 > @dstandish mentioned ([slack](https://apache-airflow.slack.com/archives/CCY359SCV/p1569608756022600?thread_ts=1569540521.006000=CCY359SCV)) if

[GitHub] [airflow] mik-laj commented on a change in pull request #5743: [AIRFLOW-5088][AIP-24] Persisting serialized DAG in DB for webserver scalability

2019-10-15 Thread GitBox
mik-laj commented on a change in pull request #5743: [AIRFLOW-5088][AIP-24] Persisting serialized DAG in DB for webserver scalability URL: https://github.com/apache/airflow/pull/5743#discussion_r335183403 ## File path: docs/howto/enable-dag-serialization.rst ## @@ -0,0

[GitHub] [airflow] ikurian-coatue opened a new pull request #6343: Cron scheduler

2019-10-15 Thread GitBox
ikurian-coatue opened a new pull request #6343: Cron scheduler URL: https://github.com/apache/airflow/pull/6343 Make sure you have checked _all_ steps below. ### Jira - [ ] My PR addresses the following [Airflow Jira](https://issues.apache.org/jira/browse/AIRFLOW/) issues and

[jira] [Commented] (AIRFLOW-4761) Airflow Task Clear function throws error

2019-10-15 Thread Ben Storrie (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-4761?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16952347#comment-16952347 ] Ben Storrie commented on AIRFLOW-4761: -- I was not. It generally happens on clearing any task

[GitHub] [airflow] aKumpan edited a comment on issue #6256: [AIRFLOW-5590] Add run_id to trigger DAG run API response

2019-10-15 Thread GitBox
aKumpan edited a comment on issue #6256: [AIRFLOW-5590] Add run_id to trigger DAG run API response URL: https://github.com/apache/airflow/pull/6256#issuecomment-538399007 Hi @XD-DENG, could you please provide more details why you do not like the [AIRFLOW-5593

[jira] [Created] (AIRFLOW-5662) Scheduler incorrectly emits occupied slots count metric as used slot count

2019-10-15 Thread QP Hou (Jira)
QP Hou created AIRFLOW-5662: --- Summary: Scheduler incorrectly emits occupied slots count metric as used slot count Key: AIRFLOW-5662 URL: https://issues.apache.org/jira/browse/AIRFLOW-5662 Project: Apache

[jira] [Commented] (AIRFLOW-5660) Scheduler becomes unresponsive when processing large DAGs on kubernetes.

2019-10-15 Thread Aditya Vishwakarma (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1695#comment-1695 ] Aditya Vishwakarma commented on AIRFLOW-5660: - [~dimberman] Can you tell me more about the

[GitHub] [airflow] dimberman commented on issue #6340: [Airflow-5660] Try to find the task in DB before regressing to search…

2019-10-15 Thread GitBox
dimberman commented on issue #6340: [Airflow-5660] Try to find the task in DB before regressing to search… URL: https://github.com/apache/airflow/pull/6340#issuecomment-542403513 LGTM. Rerunning tests. This is an automated

[GitHub] [airflow] potiuk commented on issue #6210: [AIRFLOW-5567] BaseAsyncOperator

2019-10-15 Thread GitBox
potiuk commented on issue #6210: [AIRFLOW-5567] BaseAsyncOperator URL: https://github.com/apache/airflow/pull/6210#issuecomment-542356008 Hey Jake - are you going to work on it further > I think this is very cool idea and we should make it happen :).

[GitHub] [airflow] mik-laj commented on a change in pull request #5743: [AIRFLOW-5088][AIP-24] Persisting serialized DAG in DB for webserver scalability

2019-10-15 Thread GitBox
mik-laj commented on a change in pull request #5743: [AIRFLOW-5088][AIP-24] Persisting serialized DAG in DB for webserver scalability URL: https://github.com/apache/airflow/pull/5743#discussion_r335182483 ## File path: docs/howto/enable-dag-serialization.rst ## @@ -0,0

[GitHub] [airflow] adityav commented on issue #6340: [Airflow-5660] Try to find the task in DB before regressing to search…

2019-10-15 Thread GitBox
adityav commented on issue #6340: [Airflow-5660] Try to find the task in DB before regressing to search… URL: https://github.com/apache/airflow/pull/6340#issuecomment-542429056 Looks like there is a problem with CI? I have no idea why this build failed.

[GitHub] [airflow] adityav edited a comment on issue #6340: [Airflow-5660] Try to find the task in DB before regressing to search…

2019-10-15 Thread GitBox
adityav edited a comment on issue #6340: [Airflow-5660] Try to find the task in DB before regressing to search… URL: https://github.com/apache/airflow/pull/6340#issuecomment-542429056 Looks like there is a problem with CI? I have no idea why the build failed.

[GitHub] [airflow] ashb commented on issue #4437: AIRFLOW-3632 Adding replace_microseconds parameter to dag_runs endpoint

2019-10-15 Thread GitBox
ashb commented on issue #4437: AIRFLOW-3632 Adding replace_microseconds parameter to dag_runs endpoint URL: https://github.com/apache/airflow/pull/4437#issuecomment-542429417 Someone is welcome to take up this PR, add unit tests and address the comments.

[jira] [Updated] (AIRFLOW-5660) Scheduler becomes unresponsive when processing large DAGs on kubernetes.

2019-10-15 Thread Aditya Vishwakarma (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aditya Vishwakarma updated AIRFLOW-5660: Summary: Scheduler becomes unresponsive when processing large DAGs on

[GitHub] [airflow-site] kgabryje commented on a change in pull request #76: Add list components

2019-10-15 Thread GitBox
kgabryje commented on a change in pull request #76: Add list components URL: https://github.com/apache/airflow-site/pull/76#discussion_r335048342 ## File path: landing-pages/site/layouts/partials/boxes/commiter.html ## @@ -0,0 +1,34 @@ +{{/* +* Licensed to the Apache

[GitHub] [airflow-site] kgabryje commented on a change in pull request #76: Add list components

2019-10-15 Thread GitBox
kgabryje commented on a change in pull request #76: Add list components URL: https://github.com/apache/airflow-site/pull/76#discussion_r335048389 ## File path: landing-pages/site/assets/scss/_list-boxes.scss ## @@ -0,0 +1,59 @@ +/** + * Licensed to the Apache Software

[GitHub] [airflow-site] kgabryje commented on a change in pull request #76: Add list components

2019-10-15 Thread GitBox
kgabryje commented on a change in pull request #76: Add list components URL: https://github.com/apache/airflow-site/pull/76#discussion_r335048420 ## File path: landing-pages/site/data/commiters.json ## @@ -0,0 +1,194 @@ +[ + { +"name": "Maxime “Max” Beauchemin", +

[GitHub] [airflow] adityav closed pull request #6338: [Airflow-5660] Try to find the task in DB before regressing to searching every task

2019-10-15 Thread GitBox
adityav closed pull request #6338: [Airflow-5660] Try to find the task in DB before regressing to searching every task URL: https://github.com/apache/airflow/pull/6338 This is an automated message from the Apache Git

[jira] [Commented] (AIRFLOW-4761) Airflow Task Clear function throws error

2019-10-15 Thread Connie Chen (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-4761?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16952339#comment-16952339 ] Connie Chen commented on AIRFLOW-4761: -- [~brstorrie] were you able to fix this? I am getting this

[GitHub] [airflow] enricapq commented on a change in pull request #6327: [AIRFLOW-4675] Make airflow/lineage Pylint compatible

2019-10-15 Thread GitBox
enricapq commented on a change in pull request #6327: [AIRFLOW-4675] Make airflow/lineage Pylint compatible URL: https://github.com/apache/airflow/pull/6327#discussion_r335116081 ## File path: airflow/lineage/__init__.py ## @@ -16,10 +16,16 @@ # KIND, either express or

[GitHub] [airflow] potiuk commented on a change in pull request #6285: [AIRFLOW-XXX] Updates to Breeze documentation from GSOD

2019-10-15 Thread GitBox
potiuk commented on a change in pull request #6285: [AIRFLOW-XXX] Updates to Breeze documentation from GSOD URL: https://github.com/apache/airflow/pull/6285#discussion_r335135865 ## File path: BREEZE.rst ## @@ -46,409 +46,586 @@ Here is the short 10 minute video about

[GitHub] [airflow] codecov-io commented on issue #6340: [Airflow-5660] Try to find the task in DB before regressing to search…

2019-10-15 Thread GitBox
codecov-io commented on issue #6340: [Airflow-5660] Try to find the task in DB before regressing to search… URL: https://github.com/apache/airflow/pull/6340#issuecomment-542393221 # [Codecov](https://codecov.io/gh/apache/airflow/pull/6340?src=pr=h1) Report > Merging

[GitHub] [airflow] mik-laj commented on issue #3229: [AIRFLOW-2325] Add cloudwatch task handler (IN PROGRESS)

2019-10-15 Thread GitBox
mik-laj commented on issue #3229: [AIRFLOW-2325] Add cloudwatch task handler (IN PROGRESS) URL: https://github.com/apache/airflow/pull/3229#issuecomment-542414169 https://airflow.readthedocs.io/en/latest/howto/write-logs.html There is a lack of documentation in this PR. Can you add it?

[jira] [Created] (AIRFLOW-5663) PythonVirtualenvOperator doesn't print logs until the operator is finished

2019-10-15 Thread Wei Jiang (Jira)
Wei Jiang created AIRFLOW-5663: -- Summary: PythonVirtualenvOperator doesn't print logs until the operator is finished Key: AIRFLOW-5663 URL: https://issues.apache.org/jira/browse/AIRFLOW-5663 Project:

[GitHub] [airflow] ikurian-coatue closed pull request #6343: Cron scheduler

2019-10-15 Thread GitBox
ikurian-coatue closed pull request #6343: Cron scheduler URL: https://github.com/apache/airflow/pull/6343 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use

[GitHub] [airflow] adityav opened a new pull request #6338: [Airflow-5660] Try to find the task in DB before regressing to searching every task

2019-10-15 Thread GitBox
adityav opened a new pull request #6338: [Airflow-5660] Try to find the task in DB before regressing to searching every task URL: https://github.com/apache/airflow/pull/6338 Make sure you have checked _all_ steps below. ### Jira - [ ] My PR addresses the following [Airflow

[GitHub] [airflow-site] kgabryje commented on a change in pull request #76: Add list components

2019-10-15 Thread GitBox
kgabryje commented on a change in pull request #76: Add list components URL: https://github.com/apache/airflow-site/pull/76#discussion_r335048447 ## File path: landing-pages/site/layouts/examples/list.html ## @@ -1,10 +1,62 @@ +{{/* +* Licensed to the Apache Software

[jira] [Commented] (AIRFLOW-5660) Scheduler becomes unresponsive when processing large DAGs on kubernetes.

2019-10-15 Thread Aditya Vishwakarma (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16952101#comment-16952101 ] Aditya Vishwakarma commented on AIRFLOW-5660: - [~dimberman] That is a good plan. I am a

[GitHub] [airflow] aaltay commented on issue #6334: [AIRFLOW-5657] Update the upper bound for dill

2019-10-15 Thread GitBox
aaltay commented on issue #6334: [AIRFLOW-5657] Update the upper bound for dill URL: https://github.com/apache/airflow/pull/6334#issuecomment-542307377 Thank you for the review @kaxil. I am not familiar with the process. Who could merge this change?

[GitHub] [airflow] dimberman commented on a change in pull request #6340: [Airflow-5660] Try to find the task in DB before regressing to search…

2019-10-15 Thread GitBox
dimberman commented on a change in pull request #6340: [Airflow-5660] Try to find the task in DB before regressing to search… URL: https://github.com/apache/airflow/pull/6340#discussion_r335072357 ## File path: airflow/executors/kubernetes_executor.py ## @@ -545,6 +545,26

[GitHub] [airflow] dimberman commented on a change in pull request #6340: [Airflow-5660] Try to find the task in DB before regressing to search…

2019-10-15 Thread GitBox
dimberman commented on a change in pull request #6340: [Airflow-5660] Try to find the task in DB before regressing to search… URL: https://github.com/apache/airflow/pull/6340#discussion_r335073047 ## File path: airflow/executors/kubernetes_executor.py ## @@ -545,6 +545,26

[GitHub] [airflow] SaturnFromTitan commented on issue #6315: [AIRFLOW-5640] fix get_email_address_list types

2019-10-15 Thread GitBox
SaturnFromTitan commented on issue #6315: [AIRFLOW-5640] fix get_email_address_list types URL: https://github.com/apache/airflow/pull/6315#issuecomment-542291917 臘‍♂ Yes of course. Ready for another round @ashb - now with succeeding tests

[jira] [Commented] (AIRFLOW-5657) Upgrade dill dependency

2019-10-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5657?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16952152#comment-16952152 ] ASF GitHub Bot commented on AIRFLOW-5657: - kaxil commented on pull request #6334:

[jira] [Resolved] (AIRFLOW-5657) Upgrade dill dependency

2019-10-15 Thread Kaxil Naik (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5657?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kaxil Naik resolved AIRFLOW-5657. - Fix Version/s: 2.0.0 Resolution: Fixed > Upgrade dill dependency >

[GitHub] [airflow] kaxil merged pull request #6334: [AIRFLOW-5657] Update the upper bound for dill

2019-10-15 Thread GitBox
kaxil merged pull request #6334: [AIRFLOW-5657] Update the upper bound for dill URL: https://github.com/apache/airflow/pull/6334 This is an automated message from the Apache Git Service. To respond to the message, please log

[GitHub] [airflow] Fortschritt69 opened a new pull request #6341: Updated airflow

2019-10-15 Thread GitBox
Fortschritt69 opened a new pull request #6341: Updated airflow URL: https://github.com/apache/airflow/pull/6341 Make sure you have checked _all_ steps below. ### Jira - [ ] My PR addresses the following [Airflow Jira](https://issues.apache.org/jira/browse/AIRFLOW/) issues and

[GitHub] [airflow] ToxaZ opened a new pull request #6336: [AIRFLOW-5073] Change SQLSensor to optionally treat NULL as keep poking

2019-10-15 Thread GitBox
ToxaZ opened a new pull request #6336: [AIRFLOW-5073] Change SQLSensor to optionally treat NULL as keep poking URL: https://github.com/apache/airflow/pull/6336 Fixing bug treating `"NULL"` as `NULL` in sql sensor. ### Jira - [x] My PR addresses the following: -

[GitHub] [airflow] leonardoam opened a new pull request #6337: [AIRFLOW-5659] - Add support for ephemeral storage on KubernetesPodOp…

2019-10-15 Thread GitBox
leonardoam opened a new pull request #6337: [AIRFLOW-5659] - Add support for ephemeral storage on KubernetesPodOp… URL: https://github.com/apache/airflow/pull/6337 Make sure you have checked _all_ steps below. ### Jira - [X] My PR addresses the following [Airflow

[GitHub] [airflow] adityav opened a new pull request #6340: [Airflow-5660] Try to find the task in DB before regressing to search…

2019-10-15 Thread GitBox
adityav opened a new pull request #6340: [Airflow-5660] Try to find the task in DB before regressing to search… URL: https://github.com/apache/airflow/pull/6340 …ing every task Make sure you have checked _all_ steps below. ### Jira - [ ] My PR addresses the following

[jira] [Commented] (AIRFLOW-5659) Add support for ephemeral storage on KubernetesPodOperator

2019-10-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16951971#comment-16951971 ] ASF GitHub Bot commented on AIRFLOW-5659: - leonardoam commented on pull request #6337:

[GitHub] [airflow] ToxaZ commented on a change in pull request #5913: [AIRFLOW-5073] Change SQLSensor to treat NULL failure

2019-10-15 Thread GitBox
ToxaZ commented on a change in pull request #5913: [AIRFLOW-5073] Change SQLSensor to treat NULL failure URL: https://github.com/apache/airflow/pull/5913#discussion_r334991386 ## File path: airflow/sensors/sql_sensor.py ## @@ -102,6 +98,4 @@ def poke(self, context):

[jira] [Commented] (AIRFLOW-5073) Change SQLSensor behavior returning 'success' for NULL result

2019-10-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5073?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16951970#comment-16951970 ] ASF GitHub Bot commented on AIRFLOW-5073: - ToxaZ commented on pull request #6336:

[GitHub] [airflow] feluelle commented on a change in pull request #6315: [AIRFLOW-5640] fix get_email_address_list types

2019-10-15 Thread GitBox
feluelle commented on a change in pull request #6315: [AIRFLOW-5640] fix get_email_address_list types URL: https://github.com/apache/airflow/pull/6315#discussion_r335028135 ## File path: airflow/utils/email.py ## @@ -120,13 +122,22 @@ def send_MIME_email(e_from, e_to,

[jira] [Commented] (AIRFLOW-5660) Scheduler becomes unresponsive when processing large DAGs on kubernetes.

2019-10-15 Thread Daniel Imberman (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16952097#comment-16952097 ] Daniel Imberman commented on AIRFLOW-5660: -- Also to note: This will be the type of bug we

[GitHub] [airflow] codecov-io edited a comment on issue #6057: [AIRFLOW-5442] implementing get_pandas_df method for druid broker hook

2019-10-15 Thread GitBox
codecov-io edited a comment on issue #6057: [AIRFLOW-5442] implementing get_pandas_df method for druid broker hook URL: https://github.com/apache/airflow/pull/6057#issuecomment-529290281 # [Codecov](https://codecov.io/gh/apache/airflow/pull/6057?src=pr=h1) Report > Merging

[jira] [Created] (AIRFLOW-5660) Scheduler becomes responsive when processing large DAGs on kubernetes.

2019-10-15 Thread Aditya Vishwakarma (Jira)
Aditya Vishwakarma created AIRFLOW-5660: --- Summary: Scheduler becomes responsive when processing large DAGs on kubernetes. Key: AIRFLOW-5660 URL: https://issues.apache.org/jira/browse/AIRFLOW-5660

[jira] [Commented] (AIRFLOW-5660) Scheduler becomes unresponsive when processing large DAGs on kubernetes.

2019-10-15 Thread Daniel Imberman (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16952090#comment-16952090 ] Daniel Imberman commented on AIRFLOW-5660: -- Hi [~adivish] thank you for catching this. Yeah

[jira] [Commented] (AIRFLOW-5660) Scheduler becomes unresponsive when processing large DAGs on kubernetes.

2019-10-15 Thread Daniel Imberman (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16952107#comment-16952107 ] Daniel Imberman commented on AIRFLOW-5660: -- [~adivish] fork from master and then we can cherry

[GitHub] [airflow] nuclearpinguin opened a new pull request #6339: [AIRFLOW-5661] Fix create_cluster method of GKEClusterHook

2019-10-15 Thread GitBox
nuclearpinguin opened a new pull request #6339: [AIRFLOW-5661] Fix create_cluster method of GKEClusterHook URL: https://github.com/apache/airflow/pull/6339 Make sure you have checked _all_ steps below. ### Jira - [ ] My PR addresses the following [Airflow

[jira] [Commented] (AIRFLOW-5661) Fix create_cluster method of GKEClusterHook

2019-10-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5661?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16952076#comment-16952076 ] ASF GitHub Bot commented on AIRFLOW-5661: - nuclearpinguin commented on pull request #6339:

[jira] [Created] (AIRFLOW-5661) Fix create_cluster method of GKEClusterHook

2019-10-15 Thread Tomasz Urbaszek (Jira)
Tomasz Urbaszek created AIRFLOW-5661: Summary: Fix create_cluster method of GKEClusterHook Key: AIRFLOW-5661 URL: https://issues.apache.org/jira/browse/AIRFLOW-5661 Project: Apache Airflow

[jira] [Commented] (AIRFLOW-5660) Scheduler becomes unresponsive when processing large DAGs on kubernetes.

2019-10-15 Thread Aditya Vishwakarma (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16952109#comment-16952109 ] Aditya Vishwakarma commented on AIRFLOW-5660: - PR for master:

[jira] [Commented] (AIRFLOW-5657) Upgrade dill dependency

2019-10-15 Thread ASF subversion and git services (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5657?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16952153#comment-16952153 ] ASF subversion and git services commented on AIRFLOW-5657: -- Commit

[jira] [Commented] (AIRFLOW-5636) Allow adding or overriding existing Extra Operator Links for existing Operators

2019-10-15 Thread ASF subversion and git services (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5636?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16952176#comment-16952176 ] ASF subversion and git services commented on AIRFLOW-5636: -- Commit

[jira] [Commented] (AIRFLOW-4761) Airflow Task Clear function throws error

2019-10-15 Thread Connie Chen (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-4761?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16952351#comment-16952351 ] Connie Chen commented on AIRFLOW-4761: -- [~brstorrie] the weird part is that it works with the cli

[GitHub] [airflow] mik-laj edited a comment on issue #6210: [AIRFLOW-5567] BaseAsyncOperator

2019-10-15 Thread GitBox
mik-laj edited a comment on issue #6210: [AIRFLOW-5567] BaseAsyncOperator URL: https://github.com/apache/airflow/pull/6210#issuecomment-542448658 1. I prepared a fix for you. If you don't add commit to your branch, please run the following command: ``` curl

[GitHub] [airflow] mik-laj commented on issue #6210: [AIRFLOW-5567] BaseAsyncOperator

2019-10-15 Thread GitBox
mik-laj commented on issue #6210: [AIRFLOW-5567] BaseAsyncOperator URL: https://github.com/apache/airflow/pull/6210#issuecomment-542448658 1. I prepared a fix for you. If you don't add commit to your branch, please run the following command: ``` curl

[GitHub] [airflow] milton0825 merged pull request #6297: [AIRFLOW-5224] Add encoding parameter to GoogleCloudStorageToBigQuery…

2019-10-15 Thread GitBox
milton0825 merged pull request #6297: [AIRFLOW-5224] Add encoding parameter to GoogleCloudStorageToBigQuery… URL: https://github.com/apache/airflow/pull/6297 This is an automated message from the Apache Git Service. To

[GitHub] [airflow] JonnyIncognito commented on a change in pull request #6210: [AIRFLOW-5567] BaseAsyncOperator

2019-10-15 Thread GitBox
JonnyIncognito commented on a change in pull request #6210: [AIRFLOW-5567] BaseAsyncOperator URL: https://github.com/apache/airflow/pull/6210#discussion_r335262026 ## File path: airflow/models/base_async_operator.py ## @@ -0,0 +1,161 @@ +# -*- coding: utf-8 -*- +# +#

[GitHub] [airflow] JonnyIncognito commented on a change in pull request #6210: [AIRFLOW-5567] BaseAsyncOperator

2019-10-15 Thread GitBox
JonnyIncognito commented on a change in pull request #6210: [AIRFLOW-5567] BaseAsyncOperator URL: https://github.com/apache/airflow/pull/6210#discussion_r335277825 ## File path: airflow/models/base_async_operator.py ## @@ -0,0 +1,168 @@ +# -*- coding: utf-8 -*- +# +#

[jira] [Created] (AIRFLOW-5665) Add path_exists method to SFTPHook

2019-10-15 Thread Tobiasz Kedzierski (Jira)
Tobiasz Kedzierski created AIRFLOW-5665: --- Summary: Add path_exists method to SFTPHook Key: AIRFLOW-5665 URL: https://issues.apache.org/jira/browse/AIRFLOW-5665 Project: Apache Airflow

[GitHub] [airflow] JonnyIncognito commented on a change in pull request #6210: [AIRFLOW-5567] BaseAsyncOperator

2019-10-15 Thread GitBox
JonnyIncognito commented on a change in pull request #6210: [AIRFLOW-5567] BaseAsyncOperator URL: https://github.com/apache/airflow/pull/6210#discussion_r335271755 ## File path: airflow/models/base_async_operator.py ## @@ -0,0 +1,96 @@ +# -*- coding: utf-8 -*- +# +#

[GitHub] [airflow] JonnyIncognito commented on a change in pull request #6210: [AIRFLOW-5567] BaseAsyncOperator

2019-10-15 Thread GitBox
JonnyIncognito commented on a change in pull request #6210: [AIRFLOW-5567] BaseAsyncOperator URL: https://github.com/apache/airflow/pull/6210#discussion_r335278117 ## File path: airflow/models/base_async_operator.py ## @@ -0,0 +1,161 @@ +# -*- coding: utf-8 -*- +# +#

[GitHub] [airflow] JonnyIncognito commented on a change in pull request #6210: [AIRFLOW-5567] BaseAsyncOperator

2019-10-15 Thread GitBox
JonnyIncognito commented on a change in pull request #6210: [AIRFLOW-5567] BaseAsyncOperator URL: https://github.com/apache/airflow/pull/6210#discussion_r335277825 ## File path: airflow/models/base_async_operator.py ## @@ -0,0 +1,168 @@ +# -*- coding: utf-8 -*- +# +#

[jira] [Commented] (AIRFLOW-5224) gcs_to_bq.GoogleCloudStorageToBigQueryOperator - Specify Encoding for BQ ingestion

2019-10-15 Thread ASF subversion and git services (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16952474#comment-16952474 ] ASF subversion and git services commented on AIRFLOW-5224: -- Commit

[GitHub] [airflow] JonnyIncognito commented on a change in pull request #6210: [AIRFLOW-5567] BaseAsyncOperator

2019-10-15 Thread GitBox
JonnyIncognito commented on a change in pull request #6210: [AIRFLOW-5567] BaseAsyncOperator URL: https://github.com/apache/airflow/pull/6210#discussion_r335271755 ## File path: airflow/models/base_async_operator.py ## @@ -0,0 +1,96 @@ +# -*- coding: utf-8 -*- +# +#

[GitHub] [airflow] sann3 commented on issue #6259: [AIRFLOW-XXX] Example for BigQuery to BigQuery operator

2019-10-15 Thread GitBox
sann3 commented on issue #6259: [AIRFLOW-XXX] Example for BigQuery to BigQuery operator URL: https://github.com/apache/airflow/pull/6259#issuecomment-542513553 Is anything pending from my side? This is an automated message

[GitHub] [airflow] milton0825 commented on a change in pull request #5743: [AIRFLOW-5088][AIP-24] Persisting serialized DAG in DB for webserver scalability

2019-10-15 Thread GitBox
milton0825 commented on a change in pull request #5743: [AIRFLOW-5088][AIP-24] Persisting serialized DAG in DB for webserver scalability URL: https://github.com/apache/airflow/pull/5743#discussion_r335280049 ## File path: airflow/models/serialized_dag.py ## @@ -0,0 +1,214

[jira] [Created] (AIRFLOW-5666) Create a BaseTransferToS3Operator

2019-10-15 Thread Chao-Han Tsai (Jira)
Chao-Han Tsai created AIRFLOW-5666: -- Summary: Create a BaseTransferToS3Operator Key: AIRFLOW-5666 URL: https://issues.apache.org/jira/browse/AIRFLOW-5666 Project: Apache Airflow Issue Type:

[GitHub] [airflow] ashb commented on a change in pull request #6340: [Airflow-5660] Try to find the task in DB before regressing to search…

2019-10-15 Thread GitBox
ashb commented on a change in pull request #6340: [Airflow-5660] Try to find the task in DB before regressing to search… URL: https://github.com/apache/airflow/pull/6340#discussion_r335210463 ## File path: airflow/executors/kubernetes_executor.py ## @@ -545,6 +545,27 @@

[GitHub] [airflow-site] mik-laj opened a new pull request #78: Add insert-license lint rule

2019-10-15 Thread GitBox
mik-laj opened a new pull request #78: Add insert-license lint rule URL: https://github.com/apache/airflow-site/pull/78 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [airflow-site] mik-laj opened a new pull request #79: Add .dockerignore

2019-10-15 Thread GitBox
mik-laj opened a new pull request #79: Add .dockerignore URL: https://github.com/apache/airflow-site/pull/79 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

[jira] [Commented] (AIRFLOW-5224) gcs_to_bq.GoogleCloudStorageToBigQueryOperator - Specify Encoding for BQ ingestion

2019-10-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16952473#comment-16952473 ] ASF GitHub Bot commented on AIRFLOW-5224: - milton0825 commented on pull request #6297:

[GitHub] [airflow] milton0825 commented on a change in pull request #5743: [AIRFLOW-5088][AIP-24] Persisting serialized DAG in DB for webserver scalability

2019-10-15 Thread GitBox
milton0825 commented on a change in pull request #5743: [AIRFLOW-5088][AIP-24] Persisting serialized DAG in DB for webserver scalability URL: https://github.com/apache/airflow/pull/5743#discussion_r335283942 ## File path: docs/howto/enable-dag-serialization.rst ## @@ -0,0

[jira] [Created] (AIRFLOW-5664) postgres_to_gcs operator drops milliseconds from timestamps

2019-10-15 Thread Joseph (Jira)
Joseph created AIRFLOW-5664: --- Summary: postgres_to_gcs operator drops milliseconds from timestamps Key: AIRFLOW-5664 URL: https://issues.apache.org/jira/browse/AIRFLOW-5664 Project: Apache Airflow

[GitHub] [airflow] mik-laj edited a comment on issue #6210: [AIRFLOW-5567] BaseAsyncOperator

2019-10-15 Thread GitBox
mik-laj edited a comment on issue #6210: [AIRFLOW-5567] BaseAsyncOperator URL: https://github.com/apache/airflow/pull/6210#issuecomment-542448658 1. I prepared a fix for you. If you don't add commit to your branch, please run the following command: ``` curl

[GitHub] [airflow] dstandish commented on issue #6210: [AIRFLOW-5567] BaseAsyncOperator

2019-10-15 Thread GitBox
dstandish commented on issue #6210: [AIRFLOW-5567] BaseAsyncOperator URL: https://github.com/apache/airflow/pull/6210#issuecomment-542495934 I gave this a try ... one curious thing while the task is in "waiting for retry" status, the log is not visible.

[jira] [Commented] (AIRFLOW-5665) Add path_exists method to SFTPHook

2019-10-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5665?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16952488#comment-16952488 ] ASF GitHub Bot commented on AIRFLOW-5665: - TobKed commented on pull request #6344:

[GitHub] [airflow] TobKed opened a new pull request #6344: [AIRFLOW-5665] Add path_exists method to SFTPHook

2019-10-15 Thread GitBox
TobKed opened a new pull request #6344: [AIRFLOW-5665] Add path_exists method to SFTPHook URL: https://github.com/apache/airflow/pull/6344 Make sure you have checked _all_ steps below. ### Jira - [ ] My PR addresses the following [Airflow

[GitHub] [airflow] milton0825 commented on a change in pull request #5743: [AIRFLOW-5088][AIP-24] Persisting serialized DAG in DB for webserver scalability

2019-10-15 Thread GitBox
milton0825 commented on a change in pull request #5743: [AIRFLOW-5088][AIP-24] Persisting serialized DAG in DB for webserver scalability URL: https://github.com/apache/airflow/pull/5743#discussion_r335280952 ## File path: airflow/models/serialized_dag.py ## @@ -0,0 +1,214

  1   2   3   >