[GitHub] [airflow] codecov-io edited a comment on issue #6715: [AIRFLOW-5945] Make inbuilt OperatorLinks work when using Serialization

2019-12-06 Thread GitBox
codecov-io edited a comment on issue #6715: [AIRFLOW-5945] Make inbuilt OperatorLinks work when using Serialization URL: https://github.com/apache/airflow/pull/6715#issuecomment-560962980 # [Codecov](https://codecov.io/gh/apache/airflow/pull/6715?src=pr=h1) Report > Merging

[jira] [Commented] (AIRFLOW-6056) Allow EmrAddStepsOperator to accept job_flow_name as alternative to job_flow_id

2019-12-06 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16990307#comment-16990307 ] ASF GitHub Bot commented on AIRFLOW-6056: - aviemzur commented on pull request #6655:

[jira] [Commented] (AIRFLOW-6056) Allow EmrAddStepsOperator to accept job_flow_name as alternative to job_flow_id

2019-12-06 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16990308#comment-16990308 ] ASF GitHub Bot commented on AIRFLOW-6056: - aviemzur commented on pull request #6655:

[GitHub] [airflow] aviemzur opened a new pull request #6655: [AIRFLOW-6056] Allow EmrAddStepsOperator to accept job_flow_name as alternative to job_flow_id

2019-12-06 Thread GitBox
aviemzur opened a new pull request #6655: [AIRFLOW-6056] Allow EmrAddStepsOperator to accept job_flow_name as alternative to job_flow_id URL: https://github.com/apache/airflow/pull/6655 Make sure you have checked _all_ steps below. ### Jira - [x] My PR addresses the following

[GitHub] [airflow] aviemzur closed pull request #6655: [AIRFLOW-6056] Allow EmrAddStepsOperator to accept job_flow_name as alternative to job_flow_id

2019-12-06 Thread GitBox
aviemzur closed pull request #6655: [AIRFLOW-6056] Allow EmrAddStepsOperator to accept job_flow_name as alternative to job_flow_id URL: https://github.com/apache/airflow/pull/6655 This is an automated message from the

[jira] [Commented] (AIRFLOW-5945) Fix limitation with OperatorLinks when using DAG Serialization

2019-12-06 Thread ASF subversion and git services (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16990216#comment-16990216 ] ASF subversion and git services commented on AIRFLOW-5945: -- Commit

[jira] [Commented] (AIRFLOW-5945) Fix limitation with OperatorLinks when using DAG Serialization

2019-12-06 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16990215#comment-16990215 ] ASF GitHub Bot commented on AIRFLOW-5945: - kaxil commented on pull request #6715:

[GitHub] [airflow] kaxil merged pull request #6715: [AIRFLOW-5945] Make inbuilt OperatorLinks work when using Serialization

2019-12-06 Thread GitBox
kaxil merged pull request #6715: [AIRFLOW-5945] Make inbuilt OperatorLinks work when using Serialization URL: https://github.com/apache/airflow/pull/6715 This is an automated message from the Apache Git Service. To respond

[jira] [Resolved] (AIRFLOW-5945) Fix limitation with OperatorLinks when using DAG Serialization

2019-12-06 Thread Kaxil Naik (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5945?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kaxil Naik resolved AIRFLOW-5945. - Fix Version/s: 1.10.7 2.0.0 Resolution: Fixed > Fix limitation with

[jira] [Updated] (AIRFLOW-6184) Add `email_on_retry` and `email_on_failure` for DAGs

2019-12-06 Thread Gerard Casas Saez (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6184?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gerard Casas Saez updated AIRFLOW-6184: --- Description: Currently, there's support for  `email_on_retry` and

[GitHub] [airflow] codecov-io commented on issue #6732: [AIRFLOW-6175] fixes scheduler queue bug

2019-12-06 Thread GitBox
codecov-io commented on issue #6732: [AIRFLOW-6175] fixes scheduler queue bug URL: https://github.com/apache/airflow/pull/6732#issuecomment-562805777 # [Codecov](https://codecov.io/gh/apache/airflow/pull/6732?src=pr=h1) Report > Merging

[GitHub] [airflow] codecov-io edited a comment on issue #6732: [AIRFLOW-6175] fixes scheduler queue bug

2019-12-06 Thread GitBox
codecov-io edited a comment on issue #6732: [AIRFLOW-6175] fixes scheduler queue bug URL: https://github.com/apache/airflow/pull/6732#issuecomment-562805777 # [Codecov](https://codecov.io/gh/apache/airflow/pull/6732?src=pr=h1) Report > Merging

[GitHub] [airflow] potiuk merged pull request #6729: [AIRFLOW-6172] BigQuery - Move BigQuery hook Pandas data frame system…

2019-12-06 Thread GitBox
potiuk merged pull request #6729: [AIRFLOW-6172] BigQuery - Move BigQuery hook Pandas data frame system… URL: https://github.com/apache/airflow/pull/6729 This is an automated message from the Apache Git Service. To respond

[jira] [Commented] (AIRFLOW-6172) BigQuery - Move BigQuery hook Pandas data frame system tests to separate file

2019-12-06 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16989546#comment-16989546 ] ASF GitHub Bot commented on AIRFLOW-6172: - potiuk commented on pull request #6729:

[jira] [Resolved] (AIRFLOW-6172) BigQuery - Move BigQuery hook Pandas data frame system tests to separate file

2019-12-06 Thread Jarek Potiuk (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jarek Potiuk resolved AIRFLOW-6172. --- Fix Version/s: 2.0.0 Resolution: Fixed > BigQuery - Move BigQuery hook Pandas data

[jira] [Commented] (AIRFLOW-6172) BigQuery - Move BigQuery hook Pandas data frame system tests to separate file

2019-12-06 Thread ASF subversion and git services (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16989547#comment-16989547 ] ASF subversion and git services commented on AIRFLOW-6172: -- Commit

[GitHub] [airflow] potiuk commented on a change in pull request #6740: [AIRFLOW-6181] Add InProcessExecutor

2019-12-06 Thread GitBox
potiuk commented on a change in pull request #6740: [AIRFLOW-6181] Add InProcessExecutor URL: https://github.com/apache/airflow/pull/6740#discussion_r354727038 ## File path: TESTING.rst ## @@ -276,3 +276,32 @@ your local sources to the ``/opt/airflow`` location of the

[jira] [Commented] (AIRFLOW-6187) Add Google Storage Bucket Sensor Operator

2019-12-06 Thread Kamil Bregula (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6187?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16989557#comment-16989557 ] Kamil Bregula commented on AIRFLOW-6187: Can you look here?

[GitHub] [airflow] potiuk commented on a change in pull request #6740: [AIRFLOW-6181] Add InProcessExecutor

2019-12-06 Thread GitBox
potiuk commented on a change in pull request #6740: [AIRFLOW-6181] Add InProcessExecutor URL: https://github.com/apache/airflow/pull/6740#discussion_r354728437 ## File path: airflow/models/taskinstance.py ## @@ -885,6 +887,12 @@ def _run_raw_task( context

[GitHub] [airflow] potiuk commented on a change in pull request #6740: [AIRFLOW-6181] Add InProcessExecutor

2019-12-06 Thread GitBox
potiuk commented on a change in pull request #6740: [AIRFLOW-6181] Add InProcessExecutor URL: https://github.com/apache/airflow/pull/6740#discussion_r354729105 ## File path: docs/executor/inprocess.rst ## @@ -0,0 +1,52 @@ + .. Licensed to the Apache Software Foundation

[GitHub] [airflow] potiuk commented on a change in pull request #6740: [AIRFLOW-6181] Add InProcessExecutor

2019-12-06 Thread GitBox
potiuk commented on a change in pull request #6740: [AIRFLOW-6181] Add InProcessExecutor URL: https://github.com/apache/airflow/pull/6740#discussion_r354730095 ## File path: docs/executor/inprocess.rst ## @@ -0,0 +1,52 @@ + .. Licensed to the Apache Software Foundation

[GitHub] [airflow] potiuk commented on a change in pull request #6740: [AIRFLOW-6181] Add InProcessExecutor

2019-12-06 Thread GitBox
potiuk commented on a change in pull request #6740: [AIRFLOW-6181] Add InProcessExecutor URL: https://github.com/apache/airflow/pull/6740#discussion_r354726655 ## File path: TESTING.rst ## @@ -276,3 +276,32 @@ your local sources to the ``/opt/airflow`` location of the

[GitHub] [airflow] potiuk commented on a change in pull request #6740: [AIRFLOW-6181] Add InProcessExecutor

2019-12-06 Thread GitBox
potiuk commented on a change in pull request #6740: [AIRFLOW-6181] Add InProcessExecutor URL: https://github.com/apache/airflow/pull/6740#discussion_r354729471 ## File path: docs/executor/inprocess.rst ## @@ -0,0 +1,52 @@ + .. Licensed to the Apache Software Foundation

[GitHub] [airflow] potiuk commented on a change in pull request #6740: [AIRFLOW-6181] Add InProcessExecutor

2019-12-06 Thread GitBox
potiuk commented on a change in pull request #6740: [AIRFLOW-6181] Add InProcessExecutor URL: https://github.com/apache/airflow/pull/6740#discussion_r354728833 ## File path: docs/executor/inprocess.rst ## @@ -0,0 +1,52 @@ + .. Licensed to the Apache Software Foundation

[GitHub] [airflow] potiuk commented on a change in pull request #6740: [AIRFLOW-6181] Add InProcessExecutor

2019-12-06 Thread GitBox
potiuk commented on a change in pull request #6740: [AIRFLOW-6181] Add InProcessExecutor URL: https://github.com/apache/airflow/pull/6740#discussion_r354729615 ## File path: docs/executor/inprocess.rst ## @@ -0,0 +1,52 @@ + .. Licensed to the Apache Software Foundation

[GitHub] [airflow] potiuk commented on a change in pull request #6740: [AIRFLOW-6181] Add InProcessExecutor

2019-12-06 Thread GitBox
potiuk commented on a change in pull request #6740: [AIRFLOW-6181] Add InProcessExecutor URL: https://github.com/apache/airflow/pull/6740#discussion_r354729792 ## File path: docs/executor/inprocess.rst ## @@ -0,0 +1,52 @@ + .. Licensed to the Apache Software Foundation

[GitHub] [airflow] potiuk commented on a change in pull request #6740: [AIRFLOW-6181] Add InProcessExecutor

2019-12-06 Thread GitBox
potiuk commented on a change in pull request #6740: [AIRFLOW-6181] Add InProcessExecutor URL: https://github.com/apache/airflow/pull/6740#discussion_r354729195 ## File path: docs/executor/inprocess.rst ## @@ -0,0 +1,52 @@ + .. Licensed to the Apache Software Foundation

[jira] [Commented] (AIRFLOW-6188) [Web UI] Support add DAG on web ui

2019-12-06 Thread Kamil Bregula (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16989559#comment-16989559 ] Kamil Bregula commented on AIRFLOW-6188: This is a hard task because Airflow is a distributed

[jira] [Comment Edited] (AIRFLOW-6188) [Web UI] Support add DAG on web ui

2019-12-06 Thread Kamil Bregula (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16989559#comment-16989559 ] Kamil Bregula edited comment on AIRFLOW-6188 at 12/6/19 9:17 AM: - This

[GitHub] [airflow] mik-laj commented on issue #6739: [AIRFLOW-6183] Fix flaky GCS hook gzip test

2019-12-06 Thread GitBox
mik-laj commented on issue #6739: [AIRFLOW-6183] Fix flaky GCS hook gzip test URL: https://github.com/apache/airflow/pull/6739#issuecomment-562496951 Restarted flaky test. This is an automated message from the Apache Git

[GitHub] [airflow] codecov-io commented on issue #6739: [AIRFLOW-6183] Fix flaky GCS hook gzip test

2019-12-06 Thread GitBox
codecov-io commented on issue #6739: [AIRFLOW-6183] Fix flaky GCS hook gzip test URL: https://github.com/apache/airflow/pull/6739#issuecomment-562511006 # [Codecov](https://codecov.io/gh/apache/airflow/pull/6739?src=pr=h1) Report > Merging

[GitHub] [airflow] feluelle merged pull request #6736: [AIRFLOW-XXX] Add information how to configure pytest runner

2019-12-06 Thread GitBox
feluelle merged pull request #6736: [AIRFLOW-XXX] Add information how to configure pytest runner URL: https://github.com/apache/airflow/pull/6736 This is an automated message from the Apache Git Service. To respond to the

[GitHub] [airflow] l0n3r4n83r closed pull request #6742: [Airflow-5144] fix alert on delete

2019-12-06 Thread GitBox
l0n3r4n83r closed pull request #6742: [Airflow-5144] fix alert on delete URL: https://github.com/apache/airflow/pull/6742 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [airflow] YouZhengChuan opened a new pull request #6743: fix Duplicate entry 'xxx' for key 'dag_id' errors when trigger multip…

2019-12-06 Thread GitBox
YouZhengChuan opened a new pull request #6743: fix Duplicate entry 'xxx' for key 'dag_id' errors when trigger multip… URL: https://github.com/apache/airflow/pull/6743 …le nested "subdag" Make sure you have checked _all_ steps below. ### Jira - [ ] My PR addresses the

[jira] [Created] (AIRFLOW-6189) Reduce the maximum test duration to 8 minutes

2019-12-06 Thread Kamil Bregula (Jira)
Kamil Bregula created AIRFLOW-6189: -- Summary: Reduce the maximum test duration to 8 minutes Key: AIRFLOW-6189 URL: https://issues.apache.org/jira/browse/AIRFLOW-6189 Project: Apache Airflow

[jira] [Commented] (AIRFLOW-6189) Reduce the maximum test duration to 8 minutes

2019-12-06 Thread ASF subversion and git services (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6189?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16989637#comment-16989637 ] ASF subversion and git services commented on AIRFLOW-6189: -- Commit

[GitHub] [airflow] mik-laj opened a new pull request #6744: [AIRFLOW-6189] Reduce the maximum test duration to 8 minutes

2019-12-06 Thread GitBox
mik-laj opened a new pull request #6744: [AIRFLOW-6189] Reduce the maximum test duration to 8 minutes URL: https://github.com/apache/airflow/pull/6744 Travis has an inactivity time of 10 minutes. This causes the error message never to appear because Travis stops the job. Make sure

[jira] [Commented] (AIRFLOW-6189) Reduce the maximum test duration to 8 minutes

2019-12-06 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6189?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16989638#comment-16989638 ] ASF GitHub Bot commented on AIRFLOW-6189: - mik-laj commented on pull request #6744:

[GitHub] [airflow] mik-laj merged pull request #6712: [AIRFLOW-XXX] add notice for Mesos Executor deprecation in docs

2019-12-06 Thread GitBox
mik-laj merged pull request #6712: [AIRFLOW-XXX] add notice for Mesos Executor deprecation in docs URL: https://github.com/apache/airflow/pull/6712 This is an automated message from the Apache Git Service. To respond to

[GitHub] [airflow] feluelle commented on a change in pull request #6740: [AIRFLOW-6181] Add InProcessExecutor

2019-12-06 Thread GitBox
feluelle commented on a change in pull request #6740: [AIRFLOW-6181] Add InProcessExecutor URL: https://github.com/apache/airflow/pull/6740#discussion_r354778914 ## File path: airflow/executors/executor_loader.py ## @@ -51,7 +52,7 @@ def get_default_executor(cls) ->

[GitHub] [airflow] potiuk commented on issue #6739: [AIRFLOW-6183] Fix flaky GCS hook gzip test

2019-12-06 Thread GitBox
potiuk commented on issue #6739: [AIRFLOW-6183] Fix flaky GCS hook gzip test URL: https://github.com/apache/airflow/pull/6739#issuecomment-562536744 Good catch @feluelle: I think we shoudl @nuclearpinguin. It looks like the same problem might happen there.

[GitHub] [airflow] potiuk commented on a change in pull request #6740: [AIRFLOW-6181] Add InProcessExecutor

2019-12-06 Thread GitBox
potiuk commented on a change in pull request #6740: [AIRFLOW-6181] Add InProcessExecutor URL: https://github.com/apache/airflow/pull/6740#discussion_r354788194 ## File path: airflow/executors/executor_loader.py ## @@ -51,7 +52,7 @@ def get_default_executor(cls) ->

[GitHub] [airflow] potiuk commented on a change in pull request #6740: [AIRFLOW-6181] Add InProcessExecutor

2019-12-06 Thread GitBox
potiuk commented on a change in pull request #6740: [AIRFLOW-6181] Add InProcessExecutor URL: https://github.com/apache/airflow/pull/6740#discussion_r354787964 ## File path: airflow/executors/executor_loader.py ## @@ -51,7 +52,7 @@ def get_default_executor(cls) ->

[GitHub] [airflow] ashb edited a comment on issue #6627: [AIRFLOW-5931] Use os.fork when appropriate to speed up task execution.

2019-12-06 Thread GitBox
ashb edited a comment on issue #6627: [AIRFLOW-5931] Use os.fork when appropriate to speed up task execution. URL: https://github.com/apache/airflow/pull/6627#issuecomment-559120739 I need to investigate what is happening with task logging, but otherwise this PR is working and the code is

[GitHub] [airflow] ashb edited a comment on issue #6627: [AIRFLOW-5931] Use os.fork when appropriate to speed up task execution.

2019-12-06 Thread GitBox
ashb edited a comment on issue #6627: [AIRFLOW-5931] Use os.fork when appropriate to speed up task execution. URL: https://github.com/apache/airflow/pull/6627#issuecomment-559120739 I need to investigate what is happening with task logging, but otherwise this PR is working and the code is

[jira] [Created] (AIRFLOW-6190) Task instances queued and dequeued before worker is ready, causing intermittently failed tasks

2019-12-06 Thread Bjorn Olsen (Jira)
Bjorn Olsen created AIRFLOW-6190: Summary: Task instances queued and dequeued before worker is ready, causing intermittently failed tasks Key: AIRFLOW-6190 URL: https://issues.apache.org/jira/browse/AIRFLOW-6190

[GitHub] [airflow] l0n3r4n83r opened a new pull request #6745: [Airflow-5144] confirmation dialogue on delete

2019-12-06 Thread GitBox
l0n3r4n83r opened a new pull request #6745: [Airflow-5144] confirmation dialogue on delete URL: https://github.com/apache/airflow/pull/6745 As per https://github.com/flask-admin/flask-admin/issues/1789 the deleted button did not show a confirmation alert. This issue has been fixed in

[GitHub] [airflow] nuclearpinguin commented on a change in pull request #6740: [AIRFLOW-6181] Add InProcessExecutor

2019-12-06 Thread GitBox
nuclearpinguin commented on a change in pull request #6740: [AIRFLOW-6181] Add InProcessExecutor URL: https://github.com/apache/airflow/pull/6740#discussion_r354802412 ## File path: airflow/executors/executor_loader.py ## @@ -51,7 +52,7 @@ def get_default_executor(cls) ->

[jira] [Updated] (AIRFLOW-6190) Task instances queued and dequeued before worker is ready, causing intermittently failed tasks

2019-12-06 Thread Bjorn Olsen (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bjorn Olsen updated AIRFLOW-6190: - Description: Below dag creates 20 identical simple tasks which depend on each other in

[GitHub] [airflow] l0n3r4n83r commented on issue #6742: [Airflow-5144] fix alert on delete

2019-12-06 Thread GitBox
l0n3r4n83r commented on issue #6742: [Airflow-5144] fix alert on delete URL: https://github.com/apache/airflow/pull/6742#issuecomment-562548297 @KevinYang21 https://github.com/apache/airflow/pull/6745 opened a new PR This is

[jira] [Updated] (AIRFLOW-6190) Task instances queued and dequeued before worker is ready, causing intermittently failed tasks

2019-12-06 Thread Bjorn Olsen (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bjorn Olsen updated AIRFLOW-6190: - Description: Below dag creates 20 identical simple tasks which depend on each other in

[jira] [Updated] (AIRFLOW-6190) Task instances queued and dequeued before worker is ready, causing intermittently failed tasks

2019-12-06 Thread Bjorn Olsen (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bjorn Olsen updated AIRFLOW-6190: - Description: Below dag creates 20 identical simple tasks which depend on each other in

[GitHub] [airflow] kaxil commented on a change in pull request #6715: [AIRFLOW-5945] Make inbuilt OperatorLinks work when using Serialization

2019-12-06 Thread GitBox
kaxil commented on a change in pull request #6715: [AIRFLOW-5945] Make inbuilt OperatorLinks work when using Serialization URL: https://github.com/apache/airflow/pull/6715#discussion_r354808615 ## File path: tests/serialization/test_dag_serialization.py ## @@ -381,6

[GitHub] [airflow] nuclearpinguin commented on a change in pull request #6740: [AIRFLOW-6181] Add InProcessExecutor

2019-12-06 Thread GitBox
nuclearpinguin commented on a change in pull request #6740: [AIRFLOW-6181] Add InProcessExecutor URL: https://github.com/apache/airflow/pull/6740#discussion_r354812698 ## File path: airflow/models/taskinstance.py ## @@ -885,6 +887,12 @@ def _run_raw_task(

[GitHub] [airflow] nuclearpinguin commented on a change in pull request #6740: [AIRFLOW-6181] Add InProcessExecutor

2019-12-06 Thread GitBox
nuclearpinguin commented on a change in pull request #6740: [AIRFLOW-6181] Add InProcessExecutor URL: https://github.com/apache/airflow/pull/6740#discussion_r354812890 ## File path: airflow/executors/executor_loader.py ## @@ -51,7 +52,7 @@ def get_default_executor(cls) ->

[jira] [Updated] (AIRFLOW-6190) Task instances queued and dequeued before worker is ready, causing intermittently failed tasks

2019-12-06 Thread Bjorn Olsen (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bjorn Olsen updated AIRFLOW-6190: - Description: Below dag creates 20 identical simple tasks which depend on each other in

[jira] [Updated] (AIRFLOW-6190) Task instances queued and dequeued before worker is ready, causing intermittently failed tasks

2019-12-06 Thread Bjorn Olsen (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bjorn Olsen updated AIRFLOW-6190: - Description: Below dag creates 20 identical simple tasks which depend on each other in

[jira] [Created] (AIRFLOW-6191) Adjust pytest verbosity in CI and local environment

2019-12-06 Thread Tomasz Urbaszek (Jira)
Tomasz Urbaszek created AIRFLOW-6191: Summary: Adjust pytest verbosity in CI and local environment Key: AIRFLOW-6191 URL: https://issues.apache.org/jira/browse/AIRFLOW-6191 Project: Apache Airflow

[jira] [Updated] (AIRFLOW-6190) Task instances queued and dequeued before worker is ready, causing intermittently failed tasks

2019-12-06 Thread Bjorn Olsen (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bjorn Olsen updated AIRFLOW-6190: - Description: Below dag creates 20 identical simple tasks which depend on each other in

[jira] [Commented] (AIRFLOW-6191) Adjust pytest verbosity in CI and local environment

2019-12-06 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16989734#comment-16989734 ] ASF GitHub Bot commented on AIRFLOW-6191: - nuclearpinguin commented on pull request #6746:

[jira] [Commented] (AIRFLOW-6190) Task instances queued and dequeued before worker is ready, causing intermittently failed tasks

2019-12-06 Thread Bjorn Olsen (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16989735#comment-16989735 ] Bjorn Olsen commented on AIRFLOW-6190: -- I changed the func to include a random duration sleep and

[GitHub] [airflow] nuclearpinguin opened a new pull request #6746: [AIRFLOW-6191] Adjust pytest verbosity in CI and local environment

2019-12-06 Thread GitBox
nuclearpinguin opened a new pull request #6746: [AIRFLOW-6191] Adjust pytest verbosity in CI and local environment URL: https://github.com/apache/airflow/pull/6746 Make sure you have checked _all_ steps below. ### Jira - [ ] My PR addresses the following [Airflow

[GitHub] [airflow] mik-laj commented on issue #6627: [AIRFLOW-5931] Use os.fork when appropriate to speed up task execution.

2019-12-06 Thread GitBox
mik-laj commented on issue #6627: [AIRFLOW-5931] Use os.fork when appropriate to speed up task execution. URL: https://github.com/apache/airflow/pull/6627#issuecomment-562561472 - [ ] Stackdriver Logging Handler: https://github.com/apache/airflow/pull/6660

[GitHub] [airflow] mik-laj edited a comment on issue #6627: [AIRFLOW-5931] Use os.fork when appropriate to speed up task execution.

2019-12-06 Thread GitBox
mik-laj edited a comment on issue #6627: [AIRFLOW-5931] Use os.fork when appropriate to speed up task execution. URL: https://github.com/apache/airflow/pull/6627#issuecomment-562561472 - [ ] Test Stackdriver Logging Handler: https://github.com/apache/airflow/pull/6660

[jira] [Comment Edited] (AIRFLOW-6190) Task instances queued and dequeued before worker is ready, causing intermittently failed tasks

2019-12-06 Thread Bjorn Olsen (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16989735#comment-16989735 ] Bjorn Olsen edited comment on AIRFLOW-6190 at 12/6/19 12:59 PM: I

[GitHub] [airflow] nuclearpinguin commented on issue #6746: [AIRFLOW-6191] Adjust pytest verbosity in CI and local environment

2019-12-06 Thread GitBox
nuclearpinguin commented on issue #6746: [AIRFLOW-6191] Adjust pytest verbosity in CI and local environment URL: https://github.com/apache/airflow/pull/6746#issuecomment-562562162 @mik-laj @potiuk @ashb @feluelle what are your opinions on pytest verbosity? Should we print all tests on CI

[jira] [Comment Edited] (AIRFLOW-6190) Task instances queued and dequeued before worker is ready, causing intermittently failed tasks

2019-12-06 Thread Bjorn Olsen (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16989735#comment-16989735 ] Bjorn Olsen edited comment on AIRFLOW-6190 at 12/6/19 1:02 PM: --- I changed

[GitHub] [airflow] mik-laj merged pull request #6744: [AIRFLOW-6189] Reduce the maximum test duration to 8 minutes

2019-12-06 Thread GitBox
mik-laj merged pull request #6744: [AIRFLOW-6189] Reduce the maximum test duration to 8 minutes URL: https://github.com/apache/airflow/pull/6744 This is an automated message from the Apache Git Service. To respond to the

[jira] [Commented] (AIRFLOW-6189) Reduce the maximum test duration to 8 minutes

2019-12-06 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6189?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16989739#comment-16989739 ] ASF GitHub Bot commented on AIRFLOW-6189: - mik-laj commented on pull request #6744:

[jira] [Commented] (AIRFLOW-6189) Reduce the maximum test duration to 8 minutes

2019-12-06 Thread ASF subversion and git services (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6189?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16989740#comment-16989740 ] ASF subversion and git services commented on AIRFLOW-6189: -- Commit

[GitHub] [airflow] ashb commented on issue #6627: [AIRFLOW-5931] Use os.fork when appropriate to speed up task execution.

2019-12-06 Thread GitBox
ashb commented on issue #6627: [AIRFLOW-5931] Use os.fork when appropriate to speed up task execution. URL: https://github.com/apache/airflow/pull/6627#issuecomment-562575923 > * [ ] Test Stackdriver Logging Handler: #6660 :grin: Looking at what that does it should be fine --

[jira] [Commented] (AIRFLOW-6188) [Web UI] Support add DAG on web ui

2019-12-06 Thread Kangtian (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16989768#comment-16989768 ] Kangtian commented on AIRFLOW-6188: --- [~kamil.bregula]   But in k8s cluster, dag folder can be cloud

[GitHub] [airflow] kaxil opened a new pull request #6747: [AIRFLOW-XXX] Fix broken link in CONTRIBUTING.rst

2019-12-06 Thread GitBox
kaxil opened a new pull request #6747: [AIRFLOW-XXX] Fix broken link in CONTRIBUTING.rst URL: https://github.com/apache/airflow/pull/6747 Make sure you have checked _all_ steps below. ### Jira - [x] My PR addresses the following [Airflow

[GitHub] [airflow] feluelle commented on issue #6746: [AIRFLOW-6191] Adjust pytest verbosity in CI and local environment

2019-12-06 Thread GitBox
feluelle commented on issue #6746: [AIRFLOW-6191] Adjust pytest verbosity in CI and local environment URL: https://github.com/apache/airflow/pull/6746#issuecomment-562589413  for `.` in CI This is an

[GitHub] [airflow] feluelle commented on issue #6746: [AIRFLOW-6191] Adjust pytest verbosity in CI and local environment

2019-12-06 Thread GitBox
feluelle commented on issue #6746: [AIRFLOW-6191] Adjust pytest verbosity in CI and local environment URL: https://github.com/apache/airflow/pull/6746#issuecomment-562590485 > We can increase verbosity for time being until we eliminate all timeouting tests :< Sounds reasonable.

[GitHub] [airflow] ashb commented on a change in pull request #6715: [AIRFLOW-5945] Make inbuilt OperatorLinks work when using Serialization

2019-12-06 Thread GitBox
ashb commented on a change in pull request #6715: [AIRFLOW-5945] Make inbuilt OperatorLinks work when using Serialization URL: https://github.com/apache/airflow/pull/6715#discussion_r354899097 ## File path: airflow/serialization/serialized_objects.py ## @@ -354,6 +370,65

[GitHub] [airflow] ashb commented on a change in pull request #6715: [AIRFLOW-5945] Make inbuilt OperatorLinks work when using Serialization

2019-12-06 Thread GitBox
ashb commented on a change in pull request #6715: [AIRFLOW-5945] Make inbuilt OperatorLinks work when using Serialization URL: https://github.com/apache/airflow/pull/6715#discussion_r354900317 ## File path: airflow/serialization/serialized_objects.py ## @@ -354,6 +370,65

[GitHub] [airflow] ashb commented on a change in pull request #6715: [AIRFLOW-5945] Make inbuilt OperatorLinks work when using Serialization

2019-12-06 Thread GitBox
ashb commented on a change in pull request #6715: [AIRFLOW-5945] Make inbuilt OperatorLinks work when using Serialization URL: https://github.com/apache/airflow/pull/6715#discussion_r354900317 ## File path: airflow/serialization/serialized_objects.py ## @@ -354,6 +370,65

[GitHub] [airflow] ashb commented on a change in pull request #6715: [AIRFLOW-5945] Make inbuilt OperatorLinks work when using Serialization

2019-12-06 Thread GitBox
ashb commented on a change in pull request #6715: [AIRFLOW-5945] Make inbuilt OperatorLinks work when using Serialization URL: https://github.com/apache/airflow/pull/6715#discussion_r354901371 ## File path: airflow/serialization/serialized_objects.py ## @@ -354,6 +370,65

[GitHub] [airflow] codecov-io edited a comment on issue #6745: [Airflow-5144] confirmation dialogue on delete

2019-12-06 Thread GitBox
codecov-io edited a comment on issue #6745: [Airflow-5144] confirmation dialogue on delete URL: https://github.com/apache/airflow/pull/6745#issuecomment-562636952 # [Codecov](https://codecov.io/gh/apache/airflow/pull/6745?src=pr=h1) Report > Merging

[GitHub] [airflow] codecov-io commented on issue #6745: [Airflow-5144] confirmation dialogue on delete

2019-12-06 Thread GitBox
codecov-io commented on issue #6745: [Airflow-5144] confirmation dialogue on delete URL: https://github.com/apache/airflow/pull/6745#issuecomment-562636952 # [Codecov](https://codecov.io/gh/apache/airflow/pull/6745?src=pr=h1) Report > Merging

[jira] [Resolved] (AIRFLOW-6188) [Web UI] Support add DAG on web ui

2019-12-06 Thread Ash Berlin-Taylor (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ash Berlin-Taylor resolved AIRFLOW-6188. Resolution: Won't Fix > [Web UI] Support add DAG on web ui >

[jira] [Commented] (AIRFLOW-6188) [Web UI] Support add DAG on web ui

2019-12-06 Thread Ash Berlin-Taylor (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16989933#comment-16989933 ] Ash Berlin-Taylor commented on AIRFLOW-6188: [~Kangtian] if your environment supports it

[GitHub] [airflow] zuku1985 commented on issue #6683: [AIRFLOW-6019] Add flushing in execute method for BigQueryCursor

2019-12-06 Thread GitBox
zuku1985 commented on issue #6683: [AIRFLOW-6019] Add flushing in execute method for BigQueryCursor URL: https://github.com/apache/airflow/pull/6683#issuecomment-562640758 I will need some hints on how to do it. This is an

[GitHub] [airflow] kaxil commented on a change in pull request #6715: [AIRFLOW-5945] Make inbuilt OperatorLinks work when using Serialization

2019-12-06 Thread GitBox
kaxil commented on a change in pull request #6715: [AIRFLOW-5945] Make inbuilt OperatorLinks work when using Serialization URL: https://github.com/apache/airflow/pull/6715#discussion_r354917096 ## File path: airflow/serialization/serialized_objects.py ## @@ -354,6 +370,65

[jira] [Commented] (AIRFLOW-6190) Task instances queued and dequeued before worker is ready, causing intermittently failed tasks

2019-12-06 Thread Ash Berlin-Taylor (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16989936#comment-16989936 ] Ash Berlin-Taylor commented on AIRFLOW-6190: {quote}The scheduler thinks the next task can

[jira] [Assigned] (AIRFLOW-6134) Scheduler hanging every 45 minutes, workers hanging on every job

2019-12-06 Thread Ash Berlin-Taylor (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ash Berlin-Taylor reassigned AIRFLOW-6134: -- Assignee: Ash Berlin-Taylor > Scheduler hanging every 45 minutes, workers

[jira] [Commented] (AIRFLOW-6134) Scheduler hanging every 45 minutes, workers hanging on every job

2019-12-06 Thread Brent Driskill (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16989963#comment-16989963 ] Brent Driskill commented on AIRFLOW-6134: - Just as an update, we are investigating this as an

[jira] [Commented] (AIRFLOW-4847) Update config template to reflect supporting different Celery pool implementation

2019-12-06 Thread Ash Berlin-Taylor (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-4847?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16989966#comment-16989966 ] Ash Berlin-Taylor commented on AIRFLOW-4847: Sounds good! > Update config template to

[GitHub] [airflow] ashb commented on a change in pull request #6723: [AIRFLOW-6168] allows proxyfix to be configurable

2019-12-06 Thread GitBox
ashb commented on a change in pull request #6723: [AIRFLOW-6168] allows proxyfix to be configurable URL: https://github.com/apache/airflow/pull/6723#discussion_r354928703 ## File path: docs/howto/run-behind-proxy.rst ## @@ -79,6 +79,12 @@ middleware in your

[jira] [Commented] (AIRFLOW-6173) Remote logging handler does not close at the end of run

2019-12-06 Thread Ash Berlin-Taylor (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6173?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16989979#comment-16989979 ] Ash Berlin-Taylor commented on AIRFLOW-6173: That's odd - the logging should all get closed

[jira] [Commented] (AIRFLOW-6176) Form submits change url from https to http when redirectoung

2019-12-06 Thread Ash Berlin-Taylor (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16989985#comment-16989985 ] Ash Berlin-Taylor commented on AIRFLOW-6176:

[jira] [Created] (AIRFLOW-6192) Stop creating Hook from SFTPSensor.__init__

2019-12-06 Thread Kaxil Naik (Jira)
Kaxil Naik created AIRFLOW-6192: --- Summary: Stop creating Hook from SFTPSensor.__init__ Key: AIRFLOW-6192 URL: https://issues.apache.org/jira/browse/AIRFLOW-6192 Project: Apache Airflow Issue

[jira] [Commented] (AIRFLOW-6192) Stop creating Hook from SFTPSensor.__init__

2019-12-06 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6192?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16989992#comment-16989992 ] ASF GitHub Bot commented on AIRFLOW-6192: - kaxil commented on pull request #6748:

[GitHub] [airflow] kaxil opened a new pull request #6748: [AIRFLOW-6192] Stop creating Hook from SFTPSensor.__init__

2019-12-06 Thread GitBox
kaxil opened a new pull request #6748: [AIRFLOW-6192] Stop creating Hook from SFTPSensor.__init__ URL: https://github.com/apache/airflow/pull/6748 Make sure you have checked _all_ steps below. ### Jira - [x] My PR addresses the following [Airflow

[jira] [Commented] (AIRFLOW-6176) Form submits change url from https to http when redirectoung

2019-12-06 Thread Ronald Fenner (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16990013#comment-16990013 ] Ronald Fenner commented on AIRFLOW-6176: Thanks that enable_proxy_fix worked didn't know it's

[jira] [Closed] (AIRFLOW-6176) Form submits change url from https to http when redirectoung

2019-12-06 Thread Ronald Fenner (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ronald Fenner closed AIRFLOW-6176. -- Resolution: Resolved > Form submits change url from https to http when redirectoung >

[jira] [Commented] (AIRFLOW-5523) DAGs never get cleaned up from webservers if DAG file is removed from the scheduler

2019-12-06 Thread Chris Palmer (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5523?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16990015#comment-16990015 ] Chris Palmer commented on AIRFLOW-5523: --- What is the goal here? If it is to clean up the DAGs

[jira] [Updated] (AIRFLOW-6192) Stop creating Hook from SFTPSensor.__init__

2019-12-06 Thread Kaxil Naik (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kaxil Naik updated AIRFLOW-6192: Description: >From Slack

[GitHub] [airflow] codecov-io edited a comment on issue #6652: [AIRFLOW-5548] [AIRFLOW-5550] REST API enhancement - dag info, task …

2019-12-06 Thread GitBox
codecov-io edited a comment on issue #6652: [AIRFLOW-5548] [AIRFLOW-5550] REST API enhancement - dag info, task … URL: https://github.com/apache/airflow/pull/6652#issuecomment-558277657 # [Codecov](https://codecov.io/gh/apache/airflow/pull/6652?src=pr=h1) Report > Merging

  1   2   >