[GitHub] [airflow] OmerJog commented on a change in pull request #2256: [AIRFLOW-1153] Fix issue ' params ' don't pass to HiveOperator execution context

OmerJog commented on a change in pull request #2256: [AIRFLOW-1153] Fix issue ' params ' don't pass to HiveOperator execution context URL: https://github.com/apache/airflow/pull/2256#discussion_r274266250 ## File path: airflow/utils/operator_helpers.py ## @@ -43,7 +43,8

[GitHub] [airflow] OmerJog commented on issue #4439: [AIRFLOW-3626] Fixed zipped Dag trigger

OmerJog commented on issue #4439: [AIRFLOW-3626] Fixed zipped Dag trigger URL: https://github.com/apache/airflow/pull/4439#issuecomment-481970823 @shubhparekh can you rebase? This is an automated message from the Apache Git

[GitHub] [airflow] XD-DENG commented on a change in pull request #5077: [AIRFLOW-4268] Add MsSqlToGoogleCloudStorageOperator

XD-DENG commented on a change in pull request #5077: [AIRFLOW-4268] Add MsSqlToGoogleCloudStorageOperator URL: https://github.com/apache/airflow/pull/5077#discussion_r274248794 ## File path: airflow/contrib/operators/mssql_to_gcs.py ## @@ -0,0 +1,224 @@ +# -*- coding:

[GitHub] [airflow] XD-DENG commented on a change in pull request #5077: [AIRFLOW-4268] Add MsSqlToGoogleCloudStorageOperator

XD-DENG commented on a change in pull request #5077: [AIRFLOW-4268] Add MsSqlToGoogleCloudStorageOperator URL: https://github.com/apache/airflow/pull/5077#discussion_r274247711 ## File path: tests/contrib/operators/test_mssql_to_gcs_operator.py ## @@ -0,0 +1,155 @@ +# -*-

[GitHub] [airflow] mans2singh commented on issue #4967: [AIRFLOW-4147] Operator to publish event to Redis

mans2singh commented on issue #4967: [AIRFLOW-4147] Operator to publish event to Redis URL: https://github.com/apache/airflow/pull/4967#issuecomment-481949904 @Fokko @mik-laj @XD-DENG - Please let me know if you have any additional review recommendations for this PR. Mans

[GitHub] [airflow] mans2singh commented on issue #4887: [AIRFLOW-4055] Add AWS SQS Sensor

mans2singh commented on issue #4887: [AIRFLOW-4055] Add AWS SQS Sensor URL: https://github.com/apache/airflow/pull/4887#issuecomment-481949651 @ashb @Fokko @mik-laj @XD-DENG - Please let me know if you have any advice/recommendations for this request. Thanks

[jira] [Commented] (AIRFLOW-4285) Current TI DEPS are confusing and not up to date

[ https://issues.apache.org/jira/browse/AIRFLOW-4285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16815044#comment-16815044 ] ASF GitHub Bot commented on AIRFLOW-4285: - KevinYang21 commented on pull request #5079:

[GitHub] [airflow] KevinYang21 opened a new pull request #5079: [WIP][AIRFLOW-4285] Update task dependency context defination and usage

KevinYang21 opened a new pull request #5079: [WIP][AIRFLOW-4285] Update task dependency context defination and usage URL: https://github.com/apache/airflow/pull/5079 Make sure you have checked _all_ steps below. ### Jira - [ ] My PR addresses the following [Airflow

[jira] [Assigned] (AIRFLOW-4285) Current TI DEPS are confusing and not up to date

[ https://issues.apache.org/jira/browse/AIRFLOW-4285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kevin Yang reassigned AIRFLOW-4285: --- Assignee: Kevin Yang > Current TI DEPS are confusing and not up to date >

[jira] [Created] (AIRFLOW-4285) Current TI DEPS are confusing and not up to date

Kevin Yang created AIRFLOW-4285: --- Summary: Current TI DEPS are confusing and not up to date Key: AIRFLOW-4285 URL: https://issues.apache.org/jira/browse/AIRFLOW-4285 Project: Apache Airflow

[GitHub] [airflow] bryanyang0528 edited a comment on issue #5067: [AIRFLOW-4265] Lineage backend did not work normally

bryanyang0528 edited a comment on issue #5067: [AIRFLOW-4265] Lineage backend did not work normally URL: https://github.com/apache/airflow/pull/5067#issuecomment-481934288 @NielsZeilemaker Could I initiate the backend in the `_get_backend()` function and return a backend instance?

[GitHub] [airflow] bryanyang0528 removed a comment on issue #5067: [AIRFLOW-4265] Lineage backend did not work normally

bryanyang0528 removed a comment on issue #5067: [AIRFLOW-4265] Lineage backend did not work normally URL: https://github.com/apache/airflow/pull/5067#issuecomment-481575296 @NielsZeilemaker OK. I'll create another PR for this. Thx

[GitHub] [airflow] bryanyang0528 edited a comment on issue #5067: [AIRFLOW-4265] Lineage backend did not work normally

bryanyang0528 edited a comment on issue #5067: [AIRFLOW-4265] Lineage backend did not work normally URL: https://github.com/apache/airflow/pull/5067#issuecomment-481934288 @NielsZeilemaker Could I initiate the backend in the `_get_backend()` function and return a backend instance?

[GitHub] [airflow] jmcarp commented on issue #5030: [AIRFLOW-4227] Use python3-style type annotations.

jmcarp commented on issue #5030: [AIRFLOW-4227] Use python3-style type annotations. URL: https://github.com/apache/airflow/pull/5030#issuecomment-48189 Added some typed namedtuples. Since we're supporting python3.5, we can't use variable annotations, so I used the backwards-compatible

[GitHub] [airflow] newtonle commented on issue #3956: [AIRFLOW-3123] Allow nested use of DAG as a context manager

newtonle commented on issue #3956: [AIRFLOW-3123] Allow nested use of DAG as a context manager URL: https://github.com/apache/airflow/pull/3956#issuecomment-481837428 > @newtonle curious to know why you'd need to nest this context manager? We've built some constructs that can build

[GitHub] [airflow] bcb edited a comment on issue #3956: [AIRFLOW-3123] Allow nested use of DAG as a context manager

bcb edited a comment on issue #3956: [AIRFLOW-3123] Allow nested use of DAG as a context manager URL: https://github.com/apache/airflow/pull/3956#issuecomment-481830421 @newtonle curious to know why you'd need to nest this context manager?

[GitHub] [airflow] bcb commented on issue #3956: [AIRFLOW-3123] Allow nested use of DAG as a context manager

bcb commented on issue #3956: [AIRFLOW-3123] Allow nested use of DAG as a context manager URL: https://github.com/apache/airflow/pull/3956#issuecomment-481830421 @newtonie curious to know why you'd need to nest this context manager?

[GitHub] [airflow] oxymor0n commented on issue #4390: [AIRFLOW-3584] Use ORM DAGs for index view.

oxymor0n commented on issue #4390: [AIRFLOW-3584] Use ORM DAGs for index view. URL: https://github.com/apache/airflow/pull/4390#issuecomment-481828025 hey @jmcarp , just came by a error when I was trying to downgrade from 1.10.3b1 to regular 1.10 because the down migration for

[GitHub] [airflow] oxymor0n edited a comment on issue #4390: [AIRFLOW-3584] Use ORM DAGs for index view.

oxymor0n edited a comment on issue #4390: [AIRFLOW-3584] Use ORM DAGs for index view. URL: https://github.com/apache/airflow/pull/4390#issuecomment-481828025 hey @jmcarp , just came by a error when I was trying to downgrade from 1.10.3b1 to regular 1.10 because the down migration for

[GitHub] [airflow] yishan-lin commented on issue #2708: [AIRFLOW-1746] Add a Nomad operator to trigger job from Airflow

yishan-lin commented on issue #2708: [AIRFLOW-1746] Add a Nomad operator to trigger job from Airflow URL: https://github.com/apache/airflow/pull/2708#issuecomment-481824561 Hey folks! Writing from the Nomad team. What can we do to shepherd this through?

svn commit: r33552 - /release/airflow/1.10.3/

Author: ash Date: Wed Apr 10 17:43:52 2019 New Revision: 33552 Log: Airflow 1.10.3 release from RC2 Added: release/airflow/1.10.3/ release/airflow/1.10.3/apache-airflow-1.10.3-bin.tar.gz - copied unchanged from r33494, dev/airflow/1.10.3rc2/apache-airflow-1.10.3rc2-bin.tar.gz

[jira] [Updated] (AIRFLOW-4278) Referential constraint: sla_miss.dag_id = dag.dag_id

[ https://issues.apache.org/jira/browse/AIRFLOW-4278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fokko Driesprong updated AIRFLOW-4278: -- Parent: AIRFLOW-3904 (was: AIRFLOW-4270) > Referential constraint: sla_miss.dag_id

[jira] [Updated] (AIRFLOW-4273) Referential constraint: dag.dag_id = dag_stats.dag_id

[ https://issues.apache.org/jira/browse/AIRFLOW-4273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fokko Driesprong updated AIRFLOW-4273: -- Parent: AIRFLOW-3904 (was: AIRFLOW-4270) > Referential constraint: dag.dag_id =

[jira] [Updated] (AIRFLOW-4280) Referential constraint: dag.dag_id = task_fail.dag_id

[ https://issues.apache.org/jira/browse/AIRFLOW-4280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fokko Driesprong updated AIRFLOW-4280: -- Parent: AIRFLOW-3904 (was: AIRFLOW-4270) > Referential constraint: dag.dag_id =

[jira] [Updated] (AIRFLOW-4283) Referential constraint: xcom.task_id = task_instance.task_id

[ https://issues.apache.org/jira/browse/AIRFLOW-4283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fokko Driesprong updated AIRFLOW-4283: -- Parent: AIRFLOW-3904 (was: AIRFLOW-4270) > Referential constraint: xcom.task_id =

[jira] [Updated] (AIRFLOW-4284) Referential constraint: xcom.dag_id = dag.dag_id

[ https://issues.apache.org/jira/browse/AIRFLOW-4284?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fokko Driesprong updated AIRFLOW-4284: -- Parent: AIRFLOW-3904 (was: AIRFLOW-4270) > Referential constraint: xcom.dag_id =

[jira] [Updated] (AIRFLOW-4272) Referential constraint: dag.dag_id = dag_run.dag_id

[ https://issues.apache.org/jira/browse/AIRFLOW-4272?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fokko Driesprong updated AIRFLOW-4272: -- Parent: AIRFLOW-3904 (was: AIRFLOW-4270) > Referential constraint: dag.dag_id =

[jira] [Updated] (AIRFLOW-4279) Referential constraint: task_fail.task_id = task_instance.task_id

[ https://issues.apache.org/jira/browse/AIRFLOW-4279?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fokko Driesprong updated AIRFLOW-4279: -- Parent: AIRFLOW-3904 (was: AIRFLOW-4270) > Referential constraint:

[jira] [Updated] (AIRFLOW-4282) Referential constraint: pool.pool = task_instance.pool

[ https://issues.apache.org/jira/browse/AIRFLOW-4282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fokko Driesprong updated AIRFLOW-4282: -- Parent: AIRFLOW-3904 (was: AIRFLOW-4270) > Referential constraint: pool.pool =

[jira] [Updated] (AIRFLOW-4275) Referential constraint: dag.dag_id = log.dag_id

[ https://issues.apache.org/jira/browse/AIRFLOW-4275?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fokko Driesprong updated AIRFLOW-4275: -- Parent: AIRFLOW-3904 (was: AIRFLOW-4270) > Referential constraint: dag.dag_id =

[jira] [Updated] (AIRFLOW-4281) Referential constraint: task_instance.job_id = job.id

[ https://issues.apache.org/jira/browse/AIRFLOW-4281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fokko Driesprong updated AIRFLOW-4281: -- Parent: AIRFLOW-3904 (was: AIRFLOW-4270) > Referential constraint:

[jira] [Closed] (AIRFLOW-4270) Create referential constraints in the database

[ https://issues.apache.org/jira/browse/AIRFLOW-4270?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fokko Driesprong closed AIRFLOW-4270. - Resolution: Duplicate > Create referential constraints in the database >

[jira] [Updated] (AIRFLOW-4277) Referential constraint: sla_miss.task_id = task_instance.task_id

[ https://issues.apache.org/jira/browse/AIRFLOW-4277?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fokko Driesprong updated AIRFLOW-4277: -- Parent: AIRFLOW-3904 (was: AIRFLOW-4270) > Referential constraint: sla_miss.task_id

[jira] [Updated] (AIRFLOW-4276) Referential constraint: log.task_id = task_instance.task_id

[ https://issues.apache.org/jira/browse/AIRFLOW-4276?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fokko Driesprong updated AIRFLOW-4276: -- Parent: AIRFLOW-3904 (was: AIRFLOW-4270) > Referential constraint: log.task_id =

[jira] [Updated] (AIRFLOW-4274) Referential constraint: dag.dag_id = job.dag_id

[ https://issues.apache.org/jira/browse/AIRFLOW-4274?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fokko Driesprong updated AIRFLOW-4274: -- Parent: AIRFLOW-3904 (was: AIRFLOW-4270) > Referential constraint: dag.dag_id =

[jira] [Created] (AIRFLOW-4273) Referential constraint: dag.dag_id = dag_stats.dag_id

Fokko Driesprong created AIRFLOW-4273: - Summary: Referential constraint: dag.dag_id = dag_stats.dag_id Key: AIRFLOW-4273 URL: https://issues.apache.org/jira/browse/AIRFLOW-4273 Project: Apache

[jira] [Comment Edited] (AIRFLOW-4270) Create referential constraints in the database

[ https://issues.apache.org/jira/browse/AIRFLOW-4270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16814666#comment-16814666 ] Fokko Driesprong edited comment on AIRFLOW-4270 at 4/10/19 5:05 PM:

[jira] [Commented] (AIRFLOW-4270) Create referential constraints in the database

[ https://issues.apache.org/jira/browse/AIRFLOW-4270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16814666#comment-16814666 ] Fokko Driesprong commented on AIRFLOW-4270: --- Dang, quick one [~ash] > Create referential

[jira] [Created] (AIRFLOW-4284) Referential constraint: xcom.dag_id = dag.dag_id

Fokko Driesprong created AIRFLOW-4284: - Summary: Referential constraint: xcom.dag_id = dag.dag_id Key: AIRFLOW-4284 URL: https://issues.apache.org/jira/browse/AIRFLOW-4284 Project: Apache Airflow

[jira] [Created] (AIRFLOW-4283) Referential constraint: xcom.task_id = task_instance.task_id

Fokko Driesprong created AIRFLOW-4283: - Summary: Referential constraint: xcom.task_id = task_instance.task_id Key: AIRFLOW-4283 URL: https://issues.apache.org/jira/browse/AIRFLOW-4283 Project:

[jira] [Created] (AIRFLOW-4281) Referential constraint: task_instance.job_id = job.id

Fokko Driesprong created AIRFLOW-4281: - Summary: Referential constraint: task_instance.job_id = job.id Key: AIRFLOW-4281 URL: https://issues.apache.org/jira/browse/AIRFLOW-4281 Project: Apache

[jira] [Created] (AIRFLOW-4282) Referential constraint: pool.pool = task_instance.pool

Fokko Driesprong created AIRFLOW-4282: - Summary: Referential constraint: pool.pool = task_instance.pool Key: AIRFLOW-4282 URL: https://issues.apache.org/jira/browse/AIRFLOW-4282 Project: Apache

[jira] [Created] (AIRFLOW-4280) Referential constraint: dag.dag_id = task_fail.dag_id

Fokko Driesprong created AIRFLOW-4280: - Summary: Referential constraint: dag.dag_id = task_fail.dag_id Key: AIRFLOW-4280 URL: https://issues.apache.org/jira/browse/AIRFLOW-4280 Project: Apache

[GitHub] [airflow] ashb merged pull request #5078: [AIRFLOW-XXX] Use Py3.7 on readthedocs to fix OOM

ashb merged pull request #5078: [AIRFLOW-XXX] Use Py3.7 on readthedocs to fix OOM URL: https://github.com/apache/airflow/pull/5078 This is an automated message from the Apache Git Service. To respond to the message, please

[jira] [Created] (AIRFLOW-4278) Referential constraint: sla_miss.dag_id = dag.dag_id

Fokko Driesprong created AIRFLOW-4278: - Summary: Referential constraint: sla_miss.dag_id = dag.dag_id Key: AIRFLOW-4278 URL: https://issues.apache.org/jira/browse/AIRFLOW-4278 Project: Apache

[jira] [Created] (AIRFLOW-4279) Referential constraint: task_fail.task_id = task_instance.task_id

Fokko Driesprong created AIRFLOW-4279: - Summary: Referential constraint: task_fail.task_id = task_instance.task_id Key: AIRFLOW-4279 URL: https://issues.apache.org/jira/browse/AIRFLOW-4279

[GitHub] [airflow] codecov-io commented on issue #5078: [AIRFLOW-XXX] Use Py3.7 on readthedocs to fix OOM

codecov-io commented on issue #5078: [AIRFLOW-XXX] Use Py3.7 on readthedocs to fix OOM URL: https://github.com/apache/airflow/pull/5078#issuecomment-481775709 # [Codecov](https://codecov.io/gh/apache/airflow/pull/5078?src=pr=h1) Report > Merging

[jira] [Commented] (AIRFLOW-4270) Create referential constraints in the database

[ https://issues.apache.org/jira/browse/AIRFLOW-4270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16814655#comment-16814655 ] Ash Berlin-Taylor commented on AIRFLOW-4270: Dupe of AIRFLOW-3904 > Create referential

[jira] [Created] (AIRFLOW-4275) Referential constraint: dag.dag_id = log.dag_id

Fokko Driesprong created AIRFLOW-4275: - Summary: Referential constraint: dag.dag_id = log.dag_id Key: AIRFLOW-4275 URL: https://issues.apache.org/jira/browse/AIRFLOW-4275 Project: Apache Airflow

[jira] [Created] (AIRFLOW-4276) Referential constraint: log.task_id = task_instance.task_id

Fokko Driesprong created AIRFLOW-4276: - Summary: Referential constraint: log.task_id = task_instance.task_id Key: AIRFLOW-4276 URL: https://issues.apache.org/jira/browse/AIRFLOW-4276 Project:

[jira] [Created] (AIRFLOW-4277) Referential constraint: sla_miss.task_id = task_instance.task_id

Fokko Driesprong created AIRFLOW-4277: - Summary: Referential constraint: sla_miss.task_id = task_instance.task_id Key: AIRFLOW-4277 URL: https://issues.apache.org/jira/browse/AIRFLOW-4277

[jira] [Created] (AIRFLOW-4274) Referential constraint: dag.dag_id = job.dag_id

Fokko Driesprong created AIRFLOW-4274: - Summary: Referential constraint: dag.dag_id = job.dag_id Key: AIRFLOW-4274 URL: https://issues.apache.org/jira/browse/AIRFLOW-4274 Project: Apache Airflow

[jira] [Created] (AIRFLOW-4272) Referential constraint: dag.dag_id = dag_run.dag_id

Fokko Driesprong created AIRFLOW-4272: - Summary: Referential constraint: dag.dag_id = dag_run.dag_id Key: AIRFLOW-4272 URL: https://issues.apache.org/jira/browse/AIRFLOW-4272 Project: Apache

[jira] [Created] (AIRFLOW-4271) Referential constraint: dag.pickle_id = dag_pickle.id

Fokko Driesprong created AIRFLOW-4271: - Summary: Referential constraint: dag.pickle_id = dag_pickle.id Key: AIRFLOW-4271 URL: https://issues.apache.org/jira/browse/AIRFLOW-4271 Project: Apache

[jira] [Created] (AIRFLOW-4270) Create referential constraints in the database

Fokko Driesprong created AIRFLOW-4270: - Summary: Create referential constraints in the database Key: AIRFLOW-4270 URL: https://issues.apache.org/jira/browse/AIRFLOW-4270 Project: Apache Airflow

[GitHub] [airflow] codecov-io commented on issue #5076: [AIRFLOW-4269] Minor acceleration of jobs._process_task_instances()

codecov-io commented on issue #5076: [AIRFLOW-4269] Minor acceleration of jobs._process_task_instances() URL: https://github.com/apache/airflow/pull/5076#issuecomment-481761247 # [Codecov](https://codecov.io/gh/apache/airflow/pull/5076?src=pr=h1) Report > Merging

[GitHub] [airflow] codecov-io edited a comment on issue #5077: [AIRFLOW-4268] Add MsSqlToGoogleCloudStorageOperator

codecov-io edited a comment on issue #5077: [AIRFLOW-4268] Add MsSqlToGoogleCloudStorageOperator URL: https://github.com/apache/airflow/pull/5077#issuecomment-481760912 # [Codecov](https://codecov.io/gh/apache/airflow/pull/5077?src=pr=h1) Report > Merging

[GitHub] [airflow] codecov-io commented on issue #5077: [AIRFLOW-4268] Add MsSqlToGoogleCloudStorageOperator

codecov-io commented on issue #5077: [AIRFLOW-4268] Add MsSqlToGoogleCloudStorageOperator URL: https://github.com/apache/airflow/pull/5077#issuecomment-481760912 # [Codecov](https://codecov.io/gh/apache/airflow/pull/5077?src=pr=h1) Report > Merging

[GitHub] [airflow] ashb merged pull request #5075: [AIRFLOW-XXX] Change allowed version of Jinja2 to fix CVE-2019-10906

ashb merged pull request #5075: [AIRFLOW-XXX] Change allowed version of Jinja2 to fix CVE-2019-10906 URL: https://github.com/apache/airflow/pull/5075 This is an automated message from the Apache Git Service. To respond to

[GitHub] [airflow] ashb opened a new pull request #5078: [AIRFLOW-XXX] Use Py3.7 on readthedocs to fix OOM

ashb opened a new pull request #5078: [AIRFLOW-XXX] Use Py3.7 on readthedocs to fix OOM URL: https://github.com/apache/airflow/pull/5078 ### Jira - [x] No Jira ### Description - [x] Previous builds were failing with "Command killed due to excessive memory

[jira] [Commented] (AIRFLOW-4268) Add MsSqlToGoogleCloudStorageOperator

[ https://issues.apache.org/jira/browse/AIRFLOW-4268?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16814546#comment-16814546 ] ASF GitHub Bot commented on AIRFLOW-4268: - Tomme commented on pull request #5077:

[GitHub] [airflow] OmerJog commented on issue #5077: [AIRFLOW-4268] Add MsSqlToGoogleCloudStorageOperator

OmerJog commented on issue #5077: [AIRFLOW-4268] Add MsSqlToGoogleCloudStorageOperator URL: https://github.com/apache/airflow/pull/5077#issuecomment-481740191 My 2 notes: 1. I think it's better to support all the relevant argument of the hook. For example the operator introduced in

[jira] [Updated] (AIRFLOW-4269) For-lop in jobs._process_task_instances can be faster by breaking from unnecessary steps

[ https://issues.apache.org/jira/browse/AIRFLOW-4269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaodong DENG updated AIRFLOW-4269: --- Summary: For-lop in jobs._process_task_instances can be faster by breaking from

[jira] [Updated] (AIRFLOW-4269) For-lop in jobs._process_task_instances can be faster by breaking from unnecessary steps

[ https://issues.apache.org/jira/browse/AIRFLOW-4269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaodong DENG updated AIRFLOW-4269: --- Description:

[GitHub] [airflow] Tomme opened a new pull request #5077: [AIRFLOW-4268] Add MsSqlToGoogleCloudStorageOperator

Tomme opened a new pull request #5077: [AIRFLOW-4268] Add MsSqlToGoogleCloudStorageOperator URL: https://github.com/apache/airflow/pull/5077 Make sure you have checked _all_ steps below. ### Jira - [x] My PR addresses the following

[jira] [Updated] (AIRFLOW-4269) Minor refactoring on jobs._process_task_instances()

[ https://issues.apache.org/jira/browse/AIRFLOW-4269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaodong DENG updated AIRFLOW-4269: --- Description: Issue-1:

[jira] [Updated] (AIRFLOW-4269) Minor refactoring on jobs._process_task_instances()

[ https://issues.apache.org/jira/browse/AIRFLOW-4269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaodong DENG updated AIRFLOW-4269: --- Summary: Minor refactoring on jobs._process_task_instances() (was: For-lop in

[GitHub] [airflow] XD-DENG commented on issue #5076: [AIRFLOW-4269] Minor acceleration of jobs._process_task_instances()

XD-DENG commented on issue #5076: [AIRFLOW-4269] Minor acceleration of jobs._process_task_instances() URL: https://github.com/apache/airflow/pull/5076#issuecomment-481733018 Trying going through the scheduler-related codes for improving its performance recently, so raising "small" changes

[jira] [Commented] (AIRFLOW-4269) For-lop in jobs._process_task_instances can be faster by breaking from unnecessary steps

[ https://issues.apache.org/jira/browse/AIRFLOW-4269?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16814533#comment-16814533 ] ASF GitHub Bot commented on AIRFLOW-4269: - XD-DENG commented on pull request #5076:

[GitHub] [airflow] XD-DENG opened a new pull request #5076: [AIRFLOW-4269] Minor acceleration of jobs._process_task_instances()

XD-DENG opened a new pull request #5076: [AIRFLOW-4269] Minor acceleration of jobs._process_task_instances() URL: https://github.com/apache/airflow/pull/5076 ### Jira - https://issues.apache.org/jira/browse/AIRFLOW-4269 ### Description - [x] Here are some details

[jira] [Updated] (AIRFLOW-4269) For-lop in jobs._process_task_instances can be faster by breaking from unnecessary steps

[ https://issues.apache.org/jira/browse/AIRFLOW-4269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaodong DENG updated AIRFLOW-4269: --- Affects Version/s: 1.10.2 > For-lop in jobs._process_task_instances can be faster by

[jira] [Created] (AIRFLOW-4269) For-lop in jobs._process_task_instances can be faster by breaking from unnecessary steps

Xiaodong DENG created AIRFLOW-4269: -- Summary: For-lop in jobs._process_task_instances can be faster by breaking from unnecessary steps Key: AIRFLOW-4269 URL: https://issues.apache.org/jira/browse/AIRFLOW-4269

[jira] [Updated] (AIRFLOW-4268) Add MsSqlToGoogleCloudStorageOperator

[ https://issues.apache.org/jira/browse/AIRFLOW-4268?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Elvey updated AIRFLOW-4268: -- Description: Using both 

[GitHub] [airflow] jrans edited a comment on issue #3585: [AIRFLOW-2731] Raise psutil restriction to <6.0.0

jrans edited a comment on issue #3585: [AIRFLOW-2731] Raise psutil restriction to <6.0.0 URL: https://github.com/apache/airflow/pull/3585#issuecomment-481722913 Yep sorry for that should have debugged one step further before making conclusion but regardless important to document somewhere

[GitHub] [airflow] jrans edited a comment on issue #3585: [AIRFLOW-2731] Raise psutil restriction to <6.0.0

jrans edited a comment on issue #3585: [AIRFLOW-2731] Raise psutil restriction to <6.0.0 URL: https://github.com/apache/airflow/pull/3585#issuecomment-481722913 Yep sorry for that should have debugged one step further before making conclusion but regardless important to document somewhere

[jira] [Created] (AIRFLOW-4268) Add MsSqlToGoogleCloudStorageOperator

Thomas Elvey created AIRFLOW-4268: - Summary: Add MsSqlToGoogleCloudStorageOperator Key: AIRFLOW-4268 URL: https://issues.apache.org/jira/browse/AIRFLOW-4268 Project: Apache Airflow Issue

[GitHub] [airflow] jrans commented on issue #3585: [AIRFLOW-2731] Raise psutil restriction to <6.0.0

jrans commented on issue #3585: [AIRFLOW-2731] Raise psutil restriction to <6.0.0 URL: https://github.com/apache/airflow/pull/3585#issuecomment-481722913 Yep sorry for that should have debugged one step further before making conclusion but regardless important to document somewhere as

[GitHub] [airflow] XD-DENG commented on issue #5075: [AIRFLOW-XXX] Change allowed version of Jinja2 to fix CVE-2019-10906

XD-DENG commented on issue #5075: [AIRFLOW-XXX] Change allowed version of Jinja2 to fix CVE-2019-10906 URL: https://github.com/apache/airflow/pull/5075#issuecomment-481721518 Thanks @kaxil @ashb . Thanks Ash for the clarification 

[GitHub] [airflow] ashb commented on issue #5075: [AIRFLOW-XXX] Change allowed version of Jinja2 to fix CVE-2019-10906

ashb commented on issue #5075: [AIRFLOW-XXX] Change allowed version of Jinja2 to fix CVE-2019-10906 URL: https://github.com/apache/airflow/pull/5075#issuecomment-481720698 > In Pallets Jinja before 2.10.1, str.format_map allows a sandbox escape. We should update, but this doesn't

[GitHub] [airflow] XD-DENG opened a new pull request #5075: [AIRFLOW-XXX] Change allowed version of Jinja2 to fix CVE-2019-10906

XD-DENG opened a new pull request #5075: [AIRFLOW-XXX] Change allowed version of Jinja2 to fix CVE-2019-10906 URL: https://github.com/apache/airflow/pull/5075 To change allowed version of Jinja2 to fix CVE-2019-10906 Ref: https://nvd.nist.gov/vuln/detail/CVE-2019-10906

[GitHub] [airflow] feluelle commented on issue #5069: [AIRFLOW-4266] Add mypy to setup.py devel dependencies

feluelle commented on issue #5069: [AIRFLOW-4266] Add mypy to setup.py devel dependencies URL: https://github.com/apache/airflow/pull/5069#issuecomment-481703694 That's true. But I thought that because of the different formattings, it could be useful to just reformat it completely.

[GitHub] [airflow] kaxil commented on issue #3585: [AIRFLOW-2731] Raise psutil restriction to <6.0.0

kaxil commented on issue #3585: [AIRFLOW-2731] Raise psutil restriction to <6.0.0 URL: https://github.com/apache/airflow/pull/3585#issuecomment-481702999 But that is the reason why "This PR has broken airflow for me, old limitation of <5 seems like it was for a reason.." is incorrect  .

[GitHub] [airflow] jrans commented on issue #3585: [AIRFLOW-2731] Raise psutil restriction to <6.0.0

jrans commented on issue #3585: [AIRFLOW-2731] Raise psutil restriction to <6.0.0 URL: https://github.com/apache/airflow/pull/3585#issuecomment-481700569 Thanks for getting back to me. Yes definitely not an airflow issue but highlighting the change in range in the airflow upgrade `1.10.2`

[GitHub] [airflow] Fokko edited a comment on issue #5069: [AIRFLOW-4266] Add mypy to setup.py devel dependencies

Fokko edited a comment on issue #5069: [AIRFLOW-4266] Add mypy to setup.py devel dependencies URL: https://github.com/apache/airflow/pull/5069#issuecomment-481693330 Why all the reformatting? This will potentially break a lot of other PR's.

[GitHub] [airflow] Fokko commented on issue #5069: [AIRFLOW-4266] Add mypy to setup.py devel dependencies

Fokko commented on issue #5069: [AIRFLOW-4266] Add mypy to setup.py devel dependencies URL: https://github.com/apache/airflow/pull/5069#issuecomment-481693330 Why all the reformatting? This is an automated message from the

[GitHub] [airflow] Fokko commented on issue #5070: [AIRFLOW-XXX] Add a git pre-commit hook template

Fokko commented on issue #5070: [AIRFLOW-XXX] Add a git pre-commit hook template URL: https://github.com/apache/airflow/pull/5070#issuecomment-481690135 I'm on @BasPH. I never use pre-commit hooks because I haven't found them useful. I'm still open to it if someone else finds it useful.

[GitHub] [airflow] ashb commented on issue #3585: [AIRFLOW-2731] Raise psutil restriction to <6.0.0

ashb commented on issue #3585: [AIRFLOW-2731] Raise psutil restriction to <6.0.0 URL: https://github.com/apache/airflow/pull/3585#issuecomment-481686966 The nature of that error implies it is a bug/conflicting installation of psutil. It looks almost like you have some new and some old

[jira] [Updated] (AIRFLOW-4267) Fix Task Instance duration in Graph View in Fab-Based UI

[ https://issues.apache.org/jira/browse/AIRFLOW-4267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ash Berlin-Taylor updated AIRFLOW-4267: --- Fix Version/s: (was: 1.10.3) 1.10.4 > Fix Task Instance

[GitHub] [airflow] ashb commented on issue #3719: [AIRFLOW-2874] Enables FAB's theme support

ashb commented on issue #3719: [AIRFLOW-2874] Enables FAB's theme support URL: https://github.com/apache/airflow/pull/3719#issuecomment-481651508 @holandes22 Take out of bootstrap-theme.css and put in our main.css This is an

[GitHub] [airflow] holandes22 commented on issue #3719: [AIRFLOW-2874] Enables FAB's theme support

holandes22 commented on issue #3719: [AIRFLOW-2874] Enables FAB's theme support URL: https://github.com/apache/airflow/pull/3719#issuecomment-481648984 @ashb any direction on which is the correct CSS file to place the fix? I'll gladly send a PR, but need some guidance on that

[GitHub] [airflow] yohei1126 commented on issue #4448: [AIRFLOW-3601] add location support to BigQuery operators

yohei1126 commented on issue #4448: [AIRFLOW-3601] add location support to BigQuery operators URL: https://github.com/apache/airflow/pull/4448#issuecomment-481638151 sorry continue this week. This is an automated message

[jira] [Commented] (AIRFLOW-3757) [Kubernetes Executor] Http connection times out while submitting new Pod request via kube client

[ https://issues.apache.org/jira/browse/AIRFLOW-3757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16814308#comment-16814308 ] Anand commented on AIRFLOW-3757: Not an airflow issue, but Issue with K8 Master Api server >

[jira] [Closed] (AIRFLOW-3757) [Kubernetes Executor] Http connection times out while submitting new Pod request via kube client

[ https://issues.apache.org/jira/browse/AIRFLOW-3757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anand closed AIRFLOW-3757. -- Resolution: Fixed > [Kubernetes Executor] Http connection times out while submitting new Pod > request via

[GitHub] [airflow] codecov-io commented on issue #5069: [AIRFLOW-4266] Add mypy to setup.py devel dependencies

codecov-io commented on issue #5069: [AIRFLOW-4266] Add mypy to setup.py devel dependencies URL: https://github.com/apache/airflow/pull/5069#issuecomment-481622058 # [Codecov](https://codecov.io/gh/apache/airflow/pull/5069?src=pr=h1) Report > Merging

[GitHub] [airflow] kaxil merged pull request #5052: [AIRFLOW-XXX] Build a universal wheel with LICNESE files

kaxil merged pull request #5052: [AIRFLOW-XXX] Build a universal wheel with LICNESE files URL: https://github.com/apache/airflow/pull/5052 This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [airflow] kaxil commented on issue #5052: [AIRFLOW-XXX] Build a universal wheel with LICNESE files

kaxil commented on issue #5052: [AIRFLOW-XXX] Build a universal wheel with LICNESE files URL: https://github.com/apache/airflow/pull/5052#issuecomment-481613852 Pasting this link for future references: https://wheel.readthedocs.io/en/latest/user_guide.html

[GitHub] [airflow] sumous commented on issue #4969: [AIRFLOW-4148]form_choices in DagRunModelView may be wrong

sumous commented on issue #4969: [AIRFLOW-4148]form_choices in DagRunModelView may be wrong URL: https://github.com/apache/airflow/pull/4969#issuecomment-481612145 @ashb Did you reproduce this bug? This is an automated

[GitHub] [airflow] kaxil commented on issue #4448: [AIRFLOW-3601] add location support to BigQuery operators

kaxil commented on issue #4448: [AIRFLOW-3601] add location support to BigQuery operators URL: https://github.com/apache/airflow/pull/4448#issuecomment-481611515 @yohei1126 any updates on this? This is an automated message

[jira] [Updated] (AIRFLOW-4176) [security] webui shows password - admin/log/?flt1_extra_contains=conn_password

[ https://issues.apache.org/jira/browse/AIRFLOW-4176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kaxil Naik updated AIRFLOW-4176: Fix Version/s: 1.10.4 > [security] webui shows password -

[jira] [Resolved] (AIRFLOW-2881) Add compile_assets to Release Process Documentation

[ https://issues.apache.org/jira/browse/AIRFLOW-2881?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kaxil Naik resolved AIRFLOW-2881. - Resolution: Fixed Assignee: Kaxil Naik (was: KAMALJIT CHAKRABORTY) Fix

  1   2   >