[jira] [Commented] (AIRFLOW-3674) Adding documentation on official docker images

2020-03-27 Thread Jarek Potiuk (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-3674?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17069244#comment-17069244 ] Jarek Potiuk commented on AIRFLOW-3674: --- I thin that one can be closed. We already have quite a

[jira] [Closed] (AIRFLOW-3674) Adding documentation on official docker images

2020-03-27 Thread Jarek Potiuk (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-3674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jarek Potiuk closed AIRFLOW-3674. - Resolution: Done > Adding documentation on official docker images >

[jira] [Commented] (AIRFLOW-265) Custom parameters for DockerOperator

2020-03-27 Thread Jarek Potiuk (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-265?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17069243#comment-17069243 ] Jarek Potiuk commented on AIRFLOW-265: -- Feel free [~Becky] > Custom parameters for DockerOperator

[jira] [Assigned] (AIRFLOW-265) Custom parameters for DockerOperator

2020-03-27 Thread Jarek Potiuk (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jarek Potiuk reassigned AIRFLOW-265: Assignee: Ngwe Becky > Custom parameters for DockerOperator >

[GitHub] [airflow] codecov-io edited a comment on issue #7944: [Depends on #7923] Get Airflow Variables from Hashicorp Vault

2020-03-27 Thread GitBox
codecov-io edited a comment on issue #7944: [Depends on #7923] Get Airflow Variables from Hashicorp Vault URL: https://github.com/apache/airflow/pull/7944#issuecomment-605397082 # [Codecov](https://codecov.io/gh/apache/airflow/pull/7944?src=pr=h1) Report > Merging

[GitHub] [airflow] codecov-io edited a comment on issue #7944: [Depends on #7923] Get Airflow Variables from Hashicorp Vault

2020-03-27 Thread GitBox
codecov-io edited a comment on issue #7944: [Depends on #7923] Get Airflow Variables from Hashicorp Vault URL: https://github.com/apache/airflow/pull/7944#issuecomment-605397082 # [Codecov](https://codecov.io/gh/apache/airflow/pull/7944?src=pr=h1) Report > Merging

[GitHub] [airflow] codecov-io edited a comment on issue #7944: [Depends on #7923] Get Airflow Variables from Hashicorp Vault

2020-03-27 Thread GitBox
codecov-io edited a comment on issue #7944: [Depends on #7923] Get Airflow Variables from Hashicorp Vault URL: https://github.com/apache/airflow/pull/7944#issuecomment-605397082 # [Codecov](https://codecov.io/gh/apache/airflow/pull/7944?src=pr=h1) Report > Merging

[GitHub] [airflow] codecov-io edited a comment on issue #7944: [Depends on #7923] Get Airflow Variables from Hashicorp Vault

2020-03-27 Thread GitBox
codecov-io edited a comment on issue #7944: [Depends on #7923] Get Airflow Variables from Hashicorp Vault URL: https://github.com/apache/airflow/pull/7944#issuecomment-605397082 # [Codecov](https://codecov.io/gh/apache/airflow/pull/7944?src=pr=h1) Report > Merging

[GitHub] [airflow] codecov-io edited a comment on issue #7944: [Depends on #7923] Get Airflow Variables from Hashicorp Vault

2020-03-27 Thread GitBox
codecov-io edited a comment on issue #7944: [Depends on #7923] Get Airflow Variables from Hashicorp Vault URL: https://github.com/apache/airflow/pull/7944#issuecomment-605397082 # [Codecov](https://codecov.io/gh/apache/airflow/pull/7944?src=pr=h1) Report > Merging

[GitHub] [airflow] codecov-io commented on issue #7944: [Depends on #7923] Get Airflow Variables from Hashicorp Vault

2020-03-27 Thread GitBox
codecov-io commented on issue #7944: [Depends on #7923] Get Airflow Variables from Hashicorp Vault URL: https://github.com/apache/airflow/pull/7944#issuecomment-605397082 # [Codecov](https://codecov.io/gh/apache/airflow/pull/7944?src=pr=h1) Report > Merging

[GitHub] [airflow] codecov-io edited a comment on issue #7944: [Depends on #7923] Get Airflow Variables from Hashicorp Vault

2020-03-27 Thread GitBox
codecov-io edited a comment on issue #7944: [Depends on #7923] Get Airflow Variables from Hashicorp Vault URL: https://github.com/apache/airflow/pull/7944#issuecomment-605397082 # [Codecov](https://codecov.io/gh/apache/airflow/pull/7944?src=pr=h1) Report > Merging

[GitHub] [airflow] kaxil commented on a change in pull request #7923: Get Airflow Variables from Environment Variables

2020-03-27 Thread GitBox
kaxil commented on a change in pull request #7923: Get Airflow Variables from Environment Variables URL: https://github.com/apache/airflow/pull/7923#discussion_r399615781 ## File path: airflow/secrets/metastore.py ## @@ -37,3 +37,16 @@ def get_connections(self, conn_id,

[GitHub] [airflow] kaxil commented on issue #7923: Get Airflow Variables from Environment Variables

2020-03-27 Thread GitBox
kaxil commented on issue #7923: Get Airflow Variables from Environment Variables URL: https://github.com/apache/airflow/pull/7923#issuecomment-605390632 Separated PRs into following so that it is easier to review, merge and cherry-pick: - Hashicorp Vault:

[GitHub] [airflow] kaxil commented on issue #7913: [AIRFLOW-7113] fix gantt render error

2020-03-27 Thread GitBox
kaxil commented on issue #7913: [AIRFLOW-7113] fix gantt render error URL: https://github.com/apache/airflow/pull/7913#issuecomment-605390525 > @KevinYang21, yes it's correct. > > @kaxil. Tasks fail at early stage, e.g. during parsing, won't contain the start date. When handling

[GitHub] [airflow] kaxil opened a new pull request #7946: Get Airflow Variables from GCP Secrets Manager

2020-03-27 Thread GitBox
kaxil opened a new pull request #7946: Get Airflow Variables from GCP Secrets Manager URL: https://github.com/apache/airflow/pull/7946 Depends on #7923 & #7944 Get Airflow Variables from AWS Systems Manager Parameter Store Please only check the last commit ---

[GitHub] [airflow] zhongjiajie commented on issue #7941: Webserver does not detach from console when using -D

2020-03-27 Thread GitBox
zhongjiajie commented on issue #7941: Webserver does not detach from console when using -D URL: https://github.com/apache/airflow/issues/7941#issuecomment-605388696 @dimberman Hi, I found out we have so many duplicate issue, such as this one and

[GitHub] [airflow] cong-zhu commented on issue #7913: [AIRFLOW-7113] fix gantt render error

2020-03-27 Thread GitBox
cong-zhu commented on issue #7913: [AIRFLOW-7113] fix gantt render error URL: https://github.com/apache/airflow/pull/7913#issuecomment-605388658 @KevinYang21, yes it's correct. @kaxil. Tasks fail at early stage, e.g. during parsing, won't contain the start date. When handling

[GitHub] [airflow] zhongjiajie commented on issue #7905: Pandas version pinned to < 1.0.0

2020-03-27 Thread GitBox
zhongjiajie commented on issue #7905: Pandas version pinned to < 1.0.0 URL: https://github.com/apache/airflow/issues/7905#issuecomment-605388517 Good point, I find out Pandas < 1.0.0 release in October 31, 2019 https://pandas.pydata.org/docs/whatsnew/v0.25.3.html, and I think is new

[GitHub] [airflow] kaxil opened a new pull request #7945: [Depends on #7923 & #7944]Get Airflow Variables from AWS Systems Manager Parameter Store

2020-03-27 Thread GitBox
kaxil opened a new pull request #7945: [Depends on #7923 & #7944]Get Airflow Variables from AWS Systems Manager Parameter Store URL: https://github.com/apache/airflow/pull/7945 Depends on #7923 & #7944 Get Airflow Variables from AWS Systems Manager Parameter Store **_Please

[GitHub] [airflow] kaxil opened a new pull request #7944: [Depends on #7923] Get Airflow Variables from Hashicorp Vault

2020-03-27 Thread GitBox
kaxil opened a new pull request #7944: [Depends on #7923] Get Airflow Variables from Hashicorp Vault URL: https://github.com/apache/airflow/pull/7944 Depends on #7923 Get Airflow Variables from Hashicorp Vault Please only check the last commit Make sure to mark the

[jira] [Commented] (AIRFLOW-5825) SageMakerEndpointOperator is not idempotent

2020-03-27 Thread ASF subversion and git services (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5825?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17069169#comment-17069169 ] ASF subversion and git services commented on AIRFLOW-5825: -- Commit

[jira] [Resolved] (AIRFLOW-5825) SageMakerEndpointOperator is not idempotent

2020-03-27 Thread Kaxil Naik (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5825?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kaxil Naik resolved AIRFLOW-5825. - Fix Version/s: 2.0.0 Resolution: Fixed > SageMakerEndpointOperator is not idempotent >

[jira] [Commented] (AIRFLOW-5825) SageMakerEndpointOperator is not idempotent

2020-03-27 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5825?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17069168#comment-17069168 ] ASF GitHub Bot commented on AIRFLOW-5825: - kaxil commented on pull request #7891:

[GitHub] [airflow] kaxil merged pull request #7891: [AIRFLOW-5825] SageMakerEndpointOperator is not idempotent

2020-03-27 Thread GitBox
kaxil merged pull request #7891: [AIRFLOW-5825] SageMakerEndpointOperator is not idempotent URL: https://github.com/apache/airflow/pull/7891 This is an automated message from the Apache Git Service. To respond to the

[GitHub] [airflow] codecov-io edited a comment on issue #7891: [AIRFLOW-5825] SageMakerEndpointOperator is not idempotent

2020-03-27 Thread GitBox
codecov-io edited a comment on issue #7891: [AIRFLOW-5825] SageMakerEndpointOperator is not idempotent URL: https://github.com/apache/airflow/pull/7891#issuecomment-605375211 # [Codecov](https://codecov.io/gh/apache/airflow/pull/7891?src=pr=h1) Report > Merging

[GitHub] [airflow] codecov-io commented on issue #7891: [AIRFLOW-5825] SageMakerEndpointOperator is not idempotent

2020-03-27 Thread GitBox
codecov-io commented on issue #7891: [AIRFLOW-5825] SageMakerEndpointOperator is not idempotent URL: https://github.com/apache/airflow/pull/7891#issuecomment-605375211 # [Codecov](https://codecov.io/gh/apache/airflow/pull/7891?src=pr=h1) Report > Merging

[GitHub] [airflow] KevinYang21 commented on issue #7792: [AIRFLOW-7102] Add try_number to airflow context

2020-03-27 Thread GitBox
KevinYang21 commented on issue #7792: [AIRFLOW-7102] Add try_number to airflow context URL: https://github.com/apache/airflow/pull/7792#issuecomment-605367829 I feel it can go either way, maybe a bit more clean to put that into a seperate commit. @potiuk would love to hear your opinion on

[jira] [Commented] (AIRFLOW-6574) Docker operator needs a private environment dict

2020-03-27 Thread Yousef Abu-Salah (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6574?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17069149#comment-17069149 ] Yousef Abu-Salah commented on AIRFLOW-6574: --- Can I try doing this?   > Docker operator

[jira] [Closed] (AIRFLOW-495) SSH Hook Problem - Failed to create remote temp file

2020-03-27 Thread Daniel Imberman (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Imberman closed AIRFLOW-495. --- Resolution: Auto Closed > SSH Hook Problem - Failed to create remote temp file >

[jira] [Commented] (AIRFLOW-495) SSH Hook Problem - Failed to create remote temp file

2020-03-27 Thread Daniel Imberman (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17069141#comment-17069141 ] Daniel Imberman commented on AIRFLOW-495: - This issue has been moved to

[GitHub] [airflow] dimberman opened a new issue #7943: SSH Hook Problem - Failed to create remote temp file

2020-03-27 Thread GitBox
dimberman opened a new issue #7943: SSH Hook Problem - Failed to create remote temp file URL: https://github.com/apache/airflow/issues/7943 **Apache Airflow version**: None given **Kubernetes version (if you are using kubernetes)** (use `kubectl version`):

[jira] [Commented] (AIRFLOW-486) Webserver does not detach from console when using -D

2020-03-27 Thread Daniel Imberman (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17069140#comment-17069140 ] Daniel Imberman commented on AIRFLOW-486: - This issue has been moved to

[jira] [Closed] (AIRFLOW-487) Split/Chunk operator

2020-03-27 Thread Daniel Imberman (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-487?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Imberman closed AIRFLOW-487. --- Resolution: Auto Closed > Split/Chunk operator > > >

[jira] [Closed] (AIRFLOW-486) Webserver does not detach from console when using -D

2020-03-27 Thread Daniel Imberman (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-486?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Imberman closed AIRFLOW-486. --- Resolution: Auto Closed > Webserver does not detach from console when using -D >

[jira] [Commented] (AIRFLOW-486) Webserver does not detach from console when using -D

2020-03-27 Thread Daniel Imberman (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17069139#comment-17069139 ] Daniel Imberman commented on AIRFLOW-486: - This issue has been moved to

[jira] [Closed] (AIRFLOW-484) "No data available in table" message could be clearer

2020-03-27 Thread Daniel Imberman (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-484?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Imberman closed AIRFLOW-484. --- Resolution: Fixed > "No data available in table" message could be clearer >

[GitHub] [airflow] dimberman opened a new issue #7942: Webserver does not detach from console when using -D

2020-03-27 Thread GitBox
dimberman opened a new issue #7942: Webserver does not detach from console when using -D URL: https://github.com/apache/airflow/issues/7942 **Apache Airflow version**: None given **Kubernetes version (if you are using kubernetes)** (use `kubectl version`):

[GitHub] [airflow] dimberman opened a new issue #7941: Webserver does not detach from console when using -D

2020-03-27 Thread GitBox
dimberman opened a new issue #7941: Webserver does not detach from console when using -D URL: https://github.com/apache/airflow/issues/7941 **Apache Airflow version**: 1.7.1.2 **Kubernetes version (if you are using kubernetes)** (use `kubectl version`):

[jira] [Commented] (AIRFLOW-441) DagRuns are marked as failed as soon as one task fails

2020-03-27 Thread Daniel Imberman (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-441?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17069137#comment-17069137 ] Daniel Imberman commented on AIRFLOW-441: - This issue has been moved to

[jira] [Closed] (AIRFLOW-441) DagRuns are marked as failed as soon as one task fails

2020-03-27 Thread Daniel Imberman (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-441?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Imberman closed AIRFLOW-441. --- Resolution: Auto Closed > DagRuns are marked as failed as soon as one task fails >

[GitHub] [airflow] dimberman opened a new issue #7940: DagRuns are marked as failed as soon as one task fails

2020-03-27 Thread GitBox
dimberman opened a new issue #7940: DagRuns are marked as failed as soon as one task fails URL: https://github.com/apache/airflow/issues/7940 **Apache Airflow version**: 1.7.1.2 **Kubernetes version (if you are using kubernetes)** (use `kubectl version`):

[jira] [Closed] (AIRFLOW-433) Allow tasks to be scheduled in the current schedule interval instead of previous

2020-03-27 Thread Daniel Imberman (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-433?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Imberman closed AIRFLOW-433. --- Resolution: Auto Closed > Allow tasks to be scheduled in the current schedule interval

[GitHub] [airflow] dimberman opened a new issue #7939: DagRuns are marked as failed as soon as one task fails

2020-03-27 Thread GitBox
dimberman opened a new issue #7939: DagRuns are marked as failed as soon as one task fails URL: https://github.com/apache/airflow/issues/7939 **Apache Airflow version**: 1.7.1.2 **Kubernetes version (if you are using kubernetes)** (use `kubectl version`):

[jira] [Commented] (AIRFLOW-405) MySQL backend connection management bug (related to PythonOperator)

2020-03-27 Thread Daniel Imberman (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-405?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17069135#comment-17069135 ] Daniel Imberman commented on AIRFLOW-405: - This issue has been moved to

[jira] [Commented] (AIRFLOW-433) Allow tasks to be scheduled in the current schedule interval instead of previous

2020-03-27 Thread Daniel Imberman (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-433?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17069136#comment-17069136 ] Daniel Imberman commented on AIRFLOW-433: - closing as 5172 has this > Allow tasks to be

[GitHub] [airflow] dimberman opened a new issue #7938: MySQL backend connection management bug (related to PythonOperator)

2020-03-27 Thread GitBox
dimberman opened a new issue #7938: MySQL backend connection management bug (related to PythonOperator) URL: https://github.com/apache/airflow/issues/7938 **Apache Airflow version**: 1.7.1.2 **Kubernetes version (if you are using kubernetes)** (use `kubectl version`):

[jira] [Closed] (AIRFLOW-405) MySQL backend connection management bug (related to PythonOperator)

2020-03-27 Thread Daniel Imberman (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-405?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Imberman closed AIRFLOW-405. --- Resolution: Auto Closed > MySQL backend connection management bug (related to

[jira] [Commented] (AIRFLOW-405) MySQL backend connection management bug (related to PythonOperator)

2020-03-27 Thread Daniel Imberman (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-405?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17069133#comment-17069133 ] Daniel Imberman commented on AIRFLOW-405: - This issue has been moved to

[GitHub] [airflow] dimberman opened a new issue #7937: MySQL backend connection management bug (related to PythonOperator)

2020-03-27 Thread GitBox
dimberman opened a new issue #7937: MySQL backend connection management bug (related to PythonOperator) URL: https://github.com/apache/airflow/issues/7937 **Apache Airflow version**: null **Kubernetes version (if you are using kubernetes)** (use `kubectl version`):

[jira] [Commented] (AIRFLOW-305) Fix /dag_stats not to double count TI belonging to the last DAG and still running

2020-03-27 Thread Daniel Imberman (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-305?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17069131#comment-17069131 ] Daniel Imberman commented on AIRFLOW-305: - [~sekikn] is this still an issue? > Fix /dag_stats

[GitHub] [airflow] kaxil commented on a change in pull request #7923: [WIP] Get Airflow Connection from Environment Variables & SecretsBackend

2020-03-27 Thread GitBox
kaxil commented on a change in pull request #7923: [WIP] Get Airflow Connection from Environment Variables & SecretsBackend URL: https://github.com/apache/airflow/pull/7923#discussion_r399585371 ## File path: airflow/secrets/metastore.py ## @@ -37,3 +37,16 @@ def

[jira] [Closed] (AIRFLOW-432) Failure in importing DAG

2020-03-27 Thread Daniel Imberman (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Imberman closed AIRFLOW-432. --- Resolution: Auto Closed > Failure in importing DAG > > >

[jira] [Commented] (AIRFLOW-417) UI should not print traceback for missing dag/task in URL

2020-03-27 Thread Daniel Imberman (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17069130#comment-17069130 ] Daniel Imberman commented on AIRFLOW-417: - This issue has been moved to

[GitHub] [airflow] dimberman opened a new issue #7936: UI should not print traceback for missing dag/task in URL

2020-03-27 Thread GitBox
dimberman opened a new issue #7936: UI should not print traceback for missing dag/task in URL URL: https://github.com/apache/airflow/issues/7936 **Apache Airflow version**: **Kubernetes version (if you are using kubernetes)** (use `kubectl version`):

[jira] [Closed] (AIRFLOW-417) UI should not print traceback for missing dag/task in URL

2020-03-27 Thread Daniel Imberman (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Imberman closed AIRFLOW-417. --- Resolution: Auto Closed > UI should not print traceback for missing dag/task in URL >

[jira] [Closed] (AIRFLOW-401) scheduler gets stuck without a trace

2020-03-27 Thread Daniel Imberman (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-401?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Imberman closed AIRFLOW-401. --- Resolution: Auto Closed > scheduler gets stuck without a trace >

[GitHub] [airflow] dimberman opened a new issue #7935: scheduler gets stuck without a trace

2020-03-27 Thread GitBox
dimberman opened a new issue #7935: scheduler gets stuck without a trace URL: https://github.com/apache/airflow/issues/7935 **Apache Airflow version**: **Kubernetes version (if you are using kubernetes)** (use `kubectl version`): **Environment**: - **Cloud

[jira] [Commented] (AIRFLOW-401) scheduler gets stuck without a trace

2020-03-27 Thread Daniel Imberman (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-401?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17069129#comment-17069129 ] Daniel Imberman commented on AIRFLOW-401: - This issue has been moved to

[jira] [Closed] (AIRFLOW-392) DAG runs on strange schedule in the past when deployed

2020-03-27 Thread Daniel Imberman (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Imberman closed AIRFLOW-392. --- Resolution: Auto Closed > DAG runs on strange schedule in the past when deployed >

[GitHub] [airflow] dimberman opened a new issue #7934: Support more general and customizable trigger rule options

2020-03-27 Thread GitBox
dimberman opened a new issue #7934: Support more general and customizable trigger rule options URL: https://github.com/apache/airflow/issues/7934 **Description** Currently, the trigger rule options in Airflow are very limited. For example, it is difficult to let a task

[jira] [Commented] (AIRFLOW-389) Support more general and customizable trigger rule options

2020-03-27 Thread Daniel Imberman (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17069127#comment-17069127 ] Daniel Imberman commented on AIRFLOW-389: - This issue has been moved to

[jira] [Closed] (AIRFLOW-382) YarnExecutor

2020-03-27 Thread Daniel Imberman (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Imberman closed AIRFLOW-382. --- Resolution: Auto Closed > YarnExecutor > > > Key: AIRFLOW-382

[jira] [Closed] (AIRFLOW-389) Support more general and customizable trigger rule options

2020-03-27 Thread Daniel Imberman (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Imberman closed AIRFLOW-389. --- Resolution: Auto Closed > Support more general and customizable trigger rule options >

[jira] [Closed] (AIRFLOW-377) Airflow does not warn if we create 2 dags with the same dag_id

2020-03-27 Thread Daniel Imberman (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Imberman closed AIRFLOW-377. --- Resolution: Auto Closed > Airflow does not warn if we create 2 dags with the same dag_id >

[jira] [Commented] (AIRFLOW-377) Airflow does not warn if we create 2 dags with the same dag_id

2020-03-27 Thread Daniel Imberman (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-377?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17069126#comment-17069126 ] Daniel Imberman commented on AIRFLOW-377: - This issue has been moved to

[GitHub] [airflow] ad-m commented on issue #6625: [AIRFLOW-6027] Disable API access by default

2020-03-27 Thread GitBox
ad-m commented on issue #6625: [AIRFLOW-6027] Disable API access by default URL: https://github.com/apache/airflow/pull/6625#issuecomment-605357600 Not, but GitHub support advisory ( https://help.github.com/en/github/managing-security-vulnerabilities/publishing-a-security-advisory ) for

[jira] [Closed] (AIRFLOW-376) TypeError("Boolean value of this clause is not defined")

2020-03-27 Thread Daniel Imberman (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Imberman closed AIRFLOW-376. --- Resolution: Auto Closed > TypeError("Boolean value of this clause is not defined") >

[GitHub] [airflow] dimberman opened a new issue #7933: Airflow does not warn if we create 2 dags with the same dag_id

2020-03-27 Thread GitBox
dimberman opened a new issue #7933: Airflow does not warn if we create 2 dags with the same dag_id URL: https://github.com/apache/airflow/issues/7933 **Apache Airflow version**: **Kubernetes version (if you are using kubernetes)** (use `kubectl version`):

[GitHub] [airflow] mik-laj commented on a change in pull request #7923: [WIP] Get Airflow Connection from Environment Variables & SecretsBackend

2020-03-27 Thread GitBox
mik-laj commented on a change in pull request #7923: [WIP] Get Airflow Connection from Environment Variables & SecretsBackend URL: https://github.com/apache/airflow/pull/7923#discussion_r399583454 ## File path: airflow/secrets/metastore.py ## @@ -37,3 +37,16 @@ def

[GitHub] [airflow] mik-laj commented on a change in pull request #7923: [WIP] Get Airflow Connection from Environment Variables & SecretsBackend

2020-03-27 Thread GitBox
mik-laj commented on a change in pull request #7923: [WIP] Get Airflow Connection from Environment Variables & SecretsBackend URL: https://github.com/apache/airflow/pull/7923#discussion_r399583454 ## File path: airflow/secrets/metastore.py ## @@ -37,3 +37,16 @@ def

[jira] [Commented] (AIRFLOW-372) DAGs can run before start_date time

2020-03-27 Thread Daniel Imberman (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17069121#comment-17069121 ] Daniel Imberman commented on AIRFLOW-372: - This issue has been moved to

[GitHub] [airflow] dimberman opened a new issue #7932: DAGs can run before start_date time

2020-03-27 Thread GitBox
dimberman opened a new issue #7932: DAGs can run before start_date time URL: https://github.com/apache/airflow/issues/7932 **Apache Airflow version**: **Kubernetes version (if you are using kubernetes)** (use `kubectl version`): **Environment**: - **Cloud

[jira] [Commented] (AIRFLOW-372) DAGs can run before start_date time

2020-03-27 Thread Daniel Imberman (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17069120#comment-17069120 ] Daniel Imberman commented on AIRFLOW-372: - This issue has been moved to

[jira] [Closed] (AIRFLOW-372) DAGs can run before start_date time

2020-03-27 Thread Daniel Imberman (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-372?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Imberman closed AIRFLOW-372. --- Resolution: Auto Closed > DAGs can run before start_date time >

[jira] [Closed] (AIRFLOW-357) How should I run task with owner not shell owner in AIRFLOW

2020-03-27 Thread Daniel Imberman (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-357?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Imberman closed AIRFLOW-357. --- Resolution: Auto Closed > How should I run task with owner not shell owner in AIRFLOW >

[GitHub] [airflow] dimberman opened a new issue #7931: DAGs can run before start_date time

2020-03-27 Thread GitBox
dimberman opened a new issue #7931: DAGs can run before start_date time URL: https://github.com/apache/airflow/issues/7931 **Apache Airflow version**: **Kubernetes version (if you are using kubernetes)** (use `kubectl version`): **Environment**: - **Cloud

[GitHub] [airflow] dimberman opened a new issue #7930: How should I run task with owner not shell owner in AIRFLOW

2020-03-27 Thread GitBox
dimberman opened a new issue #7930: How should I run task with owner not shell owner in AIRFLOW URL: https://github.com/apache/airflow/issues/7930 **Apache Airflow version**: **Kubernetes version (if you are using kubernetes)** (use `kubectl version`):

[jira] [Commented] (AIRFLOW-357) How should I run task with owner not shell owner in AIRFLOW

2020-03-27 Thread Daniel Imberman (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-357?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17069119#comment-17069119 ] Daniel Imberman commented on AIRFLOW-357: - This issue has been moved to

[jira] [Closed] (AIRFLOW-351) Failed to clear downstream tasks

2020-03-27 Thread Daniel Imberman (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-351?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Imberman closed AIRFLOW-351. --- Resolution: Auto Closed > Failed to clear downstream tasks >

[jira] [Commented] (AIRFLOW-351) Failed to clear downstream tasks

2020-03-27 Thread Daniel Imberman (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-351?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17069117#comment-17069117 ] Daniel Imberman commented on AIRFLOW-351: - This issue has been moved to

[GitHub] [airflow] dimberman opened a new issue #7929: Failed to clear downstream tasks

2020-03-27 Thread GitBox
dimberman opened a new issue #7929: Failed to clear downstream tasks URL: https://github.com/apache/airflow/issues/7929 **Apache Airflow version**: **Kubernetes version (if you are using kubernetes)** (use `kubectl version`): **Environment**: - **Cloud

[jira] [Closed] (AIRFLOW-344) ImportError: No module named lockfile.pidlockfile

2020-03-27 Thread Daniel Imberman (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-344?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Imberman closed AIRFLOW-344. --- Resolution: Auto Closed > ImportError: No module named lockfile.pidlockfile >

[jira] [Closed] (AIRFLOW-332) Documentation says Sub-DAG names follow a convention, but in reality it's enforced

2020-03-27 Thread Daniel Imberman (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-332?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Imberman closed AIRFLOW-332. --- Resolution: Auto Closed > Documentation says Sub-DAG names follow a convention, but in

[jira] [Commented] (AIRFLOW-332) Documentation says Sub-DAG names follow a convention, but in reality it's enforced

2020-03-27 Thread Daniel Imberman (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-332?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17069115#comment-17069115 ] Daniel Imberman commented on AIRFLOW-332: - This issue has been moved to

[GitHub] [airflow] dimberman opened a new issue #7928: Documentation says Sub-DAG names follow a convention, but in reality it's enforced

2020-03-27 Thread GitBox
dimberman opened a new issue #7928: Documentation says Sub-DAG names follow a convention, but in reality it's enforced URL: https://github.com/apache/airflow/issues/7928 **Apache Airflow version**: **Kubernetes version (if you are using kubernetes)** (use `kubectl

[jira] [Closed] (AIRFLOW-326) Unclean scheduler restarts result in zombie Task Instances

2020-03-27 Thread Daniel Imberman (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Imberman closed AIRFLOW-326. --- Resolution: Auto Closed > Unclean scheduler restarts result in zombie Task Instances >

[jira] [Commented] (AIRFLOW-326) Unclean scheduler restarts result in zombie Task Instances

2020-03-27 Thread Daniel Imberman (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17069114#comment-17069114 ] Daniel Imberman commented on AIRFLOW-326: - This issue has been moved to

[jira] [Closed] (AIRFLOW-330) Decorated PythonOperator python_callable functions don't show the original function in task code view

2020-03-27 Thread Daniel Imberman (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Imberman closed AIRFLOW-330. --- Resolution: Auto Closed > Decorated PythonOperator python_callable functions don't show the

[GitHub] [airflow] dimberman opened a new issue #7927: Unclean scheduler restarts result in zombie Task Instances

2020-03-27 Thread GitBox
dimberman opened a new issue #7927: Unclean scheduler restarts result in zombie Task Instances URL: https://github.com/apache/airflow/issues/7927 **Apache Airflow version**: **Kubernetes version (if you are using kubernetes)** (use `kubectl version`):

[jira] [Issue Comment Deleted] (AIRFLOW-326) Unclean scheduler restarts result in zombie Task Instances

2020-03-27 Thread Daniel Imberman (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Imberman updated AIRFLOW-326: Comment: was deleted (was: This issue has been moved to

[jira] [Reopened] (AIRFLOW-326) Unclean scheduler restarts result in zombie Task Instances

2020-03-27 Thread Daniel Imberman (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Imberman reopened AIRFLOW-326: - > Unclean scheduler restarts result in zombie Task Instances >

[jira] [Commented] (AIRFLOW-326) Unclean scheduler restarts result in zombie Task Instances

2020-03-27 Thread Daniel Imberman (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17069113#comment-17069113 ] Daniel Imberman commented on AIRFLOW-326: - This issue has been moved to

[jira] [Closed] (AIRFLOW-326) Unclean scheduler restarts result in zombie Task Instances

2020-03-27 Thread Daniel Imberman (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Imberman closed AIRFLOW-326. --- Resolution: Auto Closed > Unclean scheduler restarts result in zombie Task Instances >

[jira] [Closed] (AIRFLOW-108) Add data retention policy to Airflow

2020-03-27 Thread Daniel Imberman (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-108?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Imberman closed AIRFLOW-108. --- Resolution: Auto Closed > Add data retention policy to Airflow >

[GitHub] [airflow] KevinYang21 commented on issue #7913: [AIRFLOW-7113] fix gantt render error

2020-03-27 Thread GitBox
KevinYang21 commented on issue #7913: [AIRFLOW-7113] fix gantt render error URL: https://github.com/apache/airflow/pull/7913#issuecomment-605352958 The CI error looks irrelevant tho, maybe try rebase and rerun? This is an

[GitHub] [airflow] dimberman opened a new issue #7926: Kill task instances that haven't been able to heartbeat for a while

2020-03-27 Thread GitBox
dimberman opened a new issue #7926: Kill task instances that haven't been able to heartbeat for a while URL: https://github.com/apache/airflow/issues/7926 **Description** A task run by the LocalTaskJob periodically updates a timestamp to indicate that the task is still

[GitHub] [airflow] KevinYang21 commented on issue #7913: [AIRFLOW-7113] fix gantt render error

2020-03-27 Thread GitBox
KevinYang21 commented on issue #7913: [AIRFLOW-7113] fix gantt render error URL: https://github.com/apache/airflow/pull/7913#issuecomment-605352573 @kaxil I think if we have tasks marked as failed by the scheduler upon receiving executor event then we'll end up having such failing tasks

[jira] [Commented] (AIRFLOW-374) Kill task instances that haven't been able to heartbeat for a while

2020-03-27 Thread Daniel Imberman (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-374?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17069107#comment-17069107 ] Daniel Imberman commented on AIRFLOW-374: - This issue has been moved to

[jira] [Closed] (AIRFLOW-374) Kill task instances that haven't been able to heartbeat for a while

2020-03-27 Thread Daniel Imberman (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-374?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Imberman closed AIRFLOW-374. --- Resolution: Auto Closed > Kill task instances that haven't been able to heartbeat for a

[GitHub] [airflow] dimberman opened a new issue #7925: Kill task instances that haven't been able to heartbeat for a while

2020-03-27 Thread GitBox
dimberman opened a new issue #7925: Kill task instances that haven't been able to heartbeat for a while URL: https://github.com/apache/airflow/issues/7925 **Description** A task run by the LocalTaskJob periodically updates a timestamp to indicate

  1   2   3   >