[GitHub] Fokko commented on issue #2450: [Airflow-1413] Fix FTPSensor failing on error message with unexpected text.

Fokko commented on issue #2450: [Airflow-1413] Fix FTPSensor failing on error message with unexpected text. URL: https://github.com/apache/incubator-airflow/pull/2450#issuecomment-447260182 Restarted the failed job to check if the error is transient ---

[GitHub] codecov-io edited a comment on issue #2450: [Airflow-1413] Fix FTPSensor failing on error message with unexpected text.

codecov-io edited a comment on issue #2450: [Airflow-1413] Fix FTPSensor failing on error message with unexpected text. URL: https://github.com/apache/incubator-airflow/pull/2450#issuecomment-315732142 # [Codecov](https://codecov.io/gh/apache/incubator-airflow/pull/2450?src=pr&el=h1) Rep

[jira] [Moved] (AIRFLOW-3515) Remove the run_duration option

[ https://issues.apache.org/jira/browse/AIRFLOW-3515?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fokko Driesprong moved AVRO-2285 to AIRFLOW-3515: - Workflow: jira (was: no-reopen-closed, patch-avail) K

[jira] [Created] (AIRFLOW-3516) Improve K8 Executors Pod creation Rate

raman created AIRFLOW-3516: -- Summary: Improve K8 Executors Pod creation Rate Key: AIRFLOW-3516 URL: https://issues.apache.org/jira/browse/AIRFLOW-3516 Project: Apache Airflow Issue Type: Improvement

[GitHub] Fokko opened a new pull request #4320: [AIRFLOW-3515] Remove the run_duration option

Fokko opened a new pull request #4320: [AIRFLOW-3515] Remove the run_duration option URL: https://github.com/apache/incubator-airflow/pull/4320 We should not use the `run_duration` option anymore. This used to be for restarting the scheduler from time to time, but right now the sc

[jira] [Commented] (AIRFLOW-3515) Remove the run_duration option

[ https://issues.apache.org/jira/browse/AIRFLOW-3515?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16721329#comment-16721329 ] ASF GitHub Bot commented on AIRFLOW-3515: - Fokko opened a new pull request #432

[GitHub] kaxil closed pull request #4279: [AIRFLOW-3444] Explicitly set transfer operator description.

kaxil closed pull request #4279: [AIRFLOW-3444] Explicitly set transfer operator description. URL: https://github.com/apache/incubator-airflow/pull/4279 This is a PR merged from a forked repository. As GitHub hides the original diff on merge, it is displayed below for the sake of provenan

[jira] [Commented] (AIRFLOW-3444) Expand templated fields in gcs transfer service operator

[ https://issues.apache.org/jira/browse/AIRFLOW-3444?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16721343#comment-16721343 ] ASF GitHub Bot commented on AIRFLOW-3444: - kaxil closed pull request #4279: [AI

[jira] [Resolved] (AIRFLOW-3444) Expand templated fields in gcs transfer service operator

[ https://issues.apache.org/jira/browse/AIRFLOW-3444?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kaxil Naik resolved AIRFLOW-3444. - Resolution: Fixed Fix Version/s: 1.10.2 Resolved by https://github.com/apache/incubator-

[GitHub] codecov-io edited a comment on issue #4298: [AIRFLOW-3478] Make sure that the session is closed

codecov-io edited a comment on issue #4298: [AIRFLOW-3478] Make sure that the session is closed URL: https://github.com/apache/incubator-airflow/pull/4298#issuecomment-445580870 # [Codecov](https://codecov.io/gh/apache/incubator-airflow/pull/4298?src=pr&el=h1) Report > Merging [#4298

[GitHub] codecov-io edited a comment on issue #4298: [AIRFLOW-3478] Make sure that the session is closed

codecov-io edited a comment on issue #4298: [AIRFLOW-3478] Make sure that the session is closed URL: https://github.com/apache/incubator-airflow/pull/4298#issuecomment-445580870 # [Codecov](https://codecov.io/gh/apache/incubator-airflow/pull/4298?src=pr&el=h1) Report > Merging [#4298

[GitHub] asschweizer opened a new pull request #4321: incubator-airflow/scripts/ launchctl

asschweizer opened a new pull request #4321: incubator-airflow/scripts/ launchctl URL: https://github.com/apache/incubator-airflow/pull/4321 Would it be possible to add a "Running Airflow with launchctl" text to cover OS X system? --

[GitHub] codecov-io commented on issue #4320: [AIRFLOW-3515] Remove the run_duration option

codecov-io commented on issue #4320: [AIRFLOW-3515] Remove the run_duration option URL: https://github.com/apache/incubator-airflow/pull/4320#issuecomment-447315184 # [Codecov](https://codecov.io/gh/apache/incubator-airflow/pull/4320?src=pr&el=h1) Report > Merging [#4320](https://cod

[GitHub] codecov-io edited a comment on issue #4320: [AIRFLOW-3515] Remove the run_duration option

codecov-io edited a comment on issue #4320: [AIRFLOW-3515] Remove the run_duration option URL: https://github.com/apache/incubator-airflow/pull/4320#issuecomment-447315184 # [Codecov](https://codecov.io/gh/apache/incubator-airflow/pull/4320?src=pr&el=h1) Report > Merging [#4320](http

[GitHub] codecov-io edited a comment on issue #4320: [AIRFLOW-3515] Remove the run_duration option

codecov-io edited a comment on issue #4320: [AIRFLOW-3515] Remove the run_duration option URL: https://github.com/apache/incubator-airflow/pull/4320#issuecomment-447315184 # [Codecov](https://codecov.io/gh/apache/incubator-airflow/pull/4320?src=pr&el=h1) Report > Merging [#4320](http

[GitHub] Fokko commented on a change in pull request #4298: [AIRFLOW-3478] Make sure that the session is closed

Fokko commented on a change in pull request #4298: [AIRFLOW-3478] Make sure that the session is closed URL: https://github.com/apache/incubator-airflow/pull/4298#discussion_r241748690 ## File path: airflow/bin/cli.py ## @@ -423,14 +418,11 @@ def unpause(args, dag=None): d

[GitHub] codecov-io edited a comment on issue #4320: [AIRFLOW-3515] Remove the run_duration option

codecov-io edited a comment on issue #4320: [AIRFLOW-3515] Remove the run_duration option URL: https://github.com/apache/incubator-airflow/pull/4320#issuecomment-447315184 # [Codecov](https://codecov.io/gh/apache/incubator-airflow/pull/4320?src=pr&el=h1) Report > Merging [#4320](http

[GitHub] Fokko commented on a change in pull request #4298: [AIRFLOW-3478] Make sure that the session is closed

Fokko commented on a change in pull request #4298: [AIRFLOW-3478] Make sure that the session is closed URL: https://github.com/apache/incubator-airflow/pull/4298#discussion_r241748768 ## File path: airflow/api/common/experimental/mark_tasks.py ## @@ -180,18 +180,15 @@ def

[jira] [Created] (AIRFLOW-3517) Set expire_on_commit to False

Fokko Driesprong created AIRFLOW-3517: - Summary: Set expire_on_commit to False Key: AIRFLOW-3517 URL: https://issues.apache.org/jira/browse/AIRFLOW-3517 Project: Apache Airflow Issue Type

[GitHub] tiagovrtr commented on a change in pull request #3880: [AIRFLOW-461] Support autodetected schemas in BigQuery run_load

tiagovrtr commented on a change in pull request #3880: [AIRFLOW-461] Support autodetected schemas in BigQuery run_load URL: https://github.com/apache/incubator-airflow/pull/3880#discussion_r241785164 ## File path: airflow/contrib/operators/gcs_to_bq.py ## @@ -190,20 +191,

[GitHub] tiagovrtr removed a comment on issue #3880: [AIRFLOW-461] Support autodetected schemas in BigQuery run_load

tiagovrtr removed a comment on issue #3880: [AIRFLOW-461] Support autodetected schemas in BigQuery run_load URL: https://github.com/apache/incubator-airflow/pull/3880#issuecomment-447353618 This also brings issues to gcs_to_bq operator when autodetect=True and schema_fields=None, check m

[jira] [Created] (AIRFLOW-3518) Toposort is very slow

Niels Zeilemaker created AIRFLOW-3518: - Summary: Toposort is very slow Key: AIRFLOW-3518 URL: https://issues.apache.org/jira/browse/AIRFLOW-3518 Project: Apache Airflow Issue Type: New Fe

[GitHub] NielsZeilemaker opened a new pull request #4322: [AIRFLOW-3518] Performance fixes for topological_sort

NielsZeilemaker opened a new pull request #4322: [AIRFLOW-3518] Performance fixes for topological_sort URL: https://github.com/apache/incubator-airflow/pull/4322 For larger DAGs topological_sort was found to be very inefficient. Made some small changes to the code to improve the datastru

[jira] [Commented] (AIRFLOW-3518) Toposort is very slow

[ https://issues.apache.org/jira/browse/AIRFLOW-3518?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16721536#comment-16721536 ] ASF GitHub Bot commented on AIRFLOW-3518: - NielsZeilemaker opened a new pull re

[jira] [Created] (AIRFLOW-3519) example_http_operator is failing due to

Arunachalam Ambikapathi created AIRFLOW-3519: Summary: example_http_operator is failing due to Key: AIRFLOW-3519 URL: https://issues.apache.org/jira/browse/AIRFLOW-3519 Project: Apache Air

[GitHub] ashb commented on a change in pull request #4322: [AIRFLOW-3518] Performance fixes for topological_sort

ashb commented on a change in pull request #4322: [AIRFLOW-3518] Performance fixes for topological_sort URL: https://github.com/apache/incubator-airflow/pull/4322#discussion_r241802863 ## File path: airflow/models.py ## @@ -2662,10 +2662,15 @@ def __init__( }

[GitHub] ashb commented on a change in pull request #4322: [AIRFLOW-3518] Performance fixes for topological_sort

ashb commented on a change in pull request #4322: [AIRFLOW-3518] Performance fixes for topological_sort URL: https://github.com/apache/incubator-airflow/pull/4322#discussion_r241803078 ## File path: airflow/models.py ## @@ -2662,10 +2662,15 @@ def __init__( }

[jira] [Closed] (AIRFLOW-3452) Cannot view dags at /home page

[ https://issues.apache.org/jira/browse/AIRFLOW-3452?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Feng closed AIRFLOW-3452. - Resolution: Fixed > Cannot view dags at /home page > -- > >

[GitHub] Fokko commented on a change in pull request #4322: [AIRFLOW-3518] Performance fixes for topological_sort

Fokko commented on a change in pull request #4322: [AIRFLOW-3518] Performance fixes for topological_sort URL: https://github.com/apache/incubator-airflow/pull/4322#discussion_r241831876 ## File path: airflow/models.py ## @@ -2662,10 +2662,15 @@ def __init__( }

[GitHub] ashb commented on a change in pull request #4322: [AIRFLOW-3518] Performance fixes for topological_sort

ashb commented on a change in pull request #4322: [AIRFLOW-3518] Performance fixes for topological_sort URL: https://github.com/apache/incubator-airflow/pull/4322#discussion_r241834740 ## File path: airflow/models.py ## @@ -2662,10 +2662,15 @@ def __init__( }

[GitHub] Fokko commented on a change in pull request #4322: [AIRFLOW-3518] Performance fixes for topological_sort

Fokko commented on a change in pull request #4322: [AIRFLOW-3518] Performance fixes for topological_sort URL: https://github.com/apache/incubator-airflow/pull/4322#discussion_r241836663 ## File path: airflow/models.py ## @@ -2662,10 +2662,15 @@ def __init__( }

[GitHub] stale[bot] commented on issue #3997: [AIRFLOW-3153] send dag last_run to statsd

stale[bot] commented on issue #3997: [AIRFLOW-3153] send dag last_run to statsd URL: https://github.com/apache/incubator-airflow/pull/3997#issuecomment-447473771 This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activi

[GitHub] eran-levy commented on issue #4312: AIRFLOW-3508: add slugify env to build.sh script

eran-levy commented on issue #4312: AIRFLOW-3508: add slugify env to build.sh script URL: https://github.com/apache/incubator-airflow/pull/4312#issuecomment-447541159 @ashb @feng-tao thanks, see my last commit. I know the release notes (https://github.com/apache/incubator-airflow/blob/mas

[GitHub] feng-tao commented on issue #4322: [AIRFLOW-3518] Performance fixes for topological_sort

feng-tao commented on issue #4322: [AIRFLOW-3518] Performance fixes for topological_sort URL: https://github.com/apache/incubator-airflow/pull/4322#issuecomment-447542271 @ashb , I think whether to compare dag_id or not doesn't seem to matter that much. From the code, if ```self.task_id

[jira] [Created] (AIRFLOW-3520) RBAC UI seems to have bug in master branch

Tao Feng created AIRFLOW-3520: - Summary: RBAC UI seems to have bug in master branch Key: AIRFLOW-3520 URL: https://issues.apache.org/jira/browse/AIRFLOW-3520 Project: Apache Airflow Issue Type: B

[jira] [Commented] (AIRFLOW-3520) RBAC UI seems to have bug in master branch

[ https://issues.apache.org/jira/browse/AIRFLOW-3520?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16722047#comment-16722047 ] Tao Feng commented on AIRFLOW-3520: --- after rerun npm install, doesn't seem to be the

[jira] [Closed] (AIRFLOW-3520) RBAC UI seems to have bug in master branch

[ https://issues.apache.org/jira/browse/AIRFLOW-3520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Feng closed AIRFLOW-3520. - Resolution: Not A Problem > RBAC UI seems to have bug in master branch > --

[jira] [Commented] (AIRFLOW-3166) RBAC DAG Level Access Control - Admin can't see DAGS on the UI

[ https://issues.apache.org/jira/browse/AIRFLOW-3166?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16722053#comment-16722053 ] Tao Feng commented on AIRFLOW-3166: --- hey [~sid88in] , could you give a try with the l