[jira] [Assigned] (AIRFLOW-6778) Add a DAGs PVC Mount Point Option for Workers under Kubernetes Executor

[ https://issues.apache.org/jira/browse/AIRFLOW-6778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bjorn Olsen reassigned AIRFLOW-6778: Assignee: Daniel Imberman (was: Bjorn Olsen) > Add a DAGs PVC Mount Point Option for

[jira] [Assigned] (AIRFLOW-6778) Add a DAGs PVC Mount Point Option for Workers under Kubernetes Executor

[ https://issues.apache.org/jira/browse/AIRFLOW-6778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bjorn Olsen reassigned AIRFLOW-6778: Assignee: Bjorn Olsen > Add a DAGs PVC Mount Point Option for Workers under Kubernetes

[jira] [Created] (AIRFLOW-6975) Base AWSHook AssumeRoleWithSAML

Bjorn Olsen created AIRFLOW-6975: Summary: Base AWSHook AssumeRoleWithSAML Key: AIRFLOW-6975 URL: https://issues.apache.org/jira/browse/AIRFLOW-6975 Project: Apache Airflow Issue Type:

[jira] [Updated] (AIRFLOW-6944) Allow AWS DataSync to "catch up" when Task is already running

[ https://issues.apache.org/jira/browse/AIRFLOW-6944?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bjorn Olsen updated AIRFLOW-6944: - Description: Current AWS DataSyncOperator attempts to start running a DataSync Task, with no

[jira] [Updated] (AIRFLOW-6944) Allow AWS DataSync to "catch up" when Task is already running

[ https://issues.apache.org/jira/browse/AIRFLOW-6944?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bjorn Olsen updated AIRFLOW-6944: - Description: Current AWS DataSyncOperator attempts to start running a DataSync Task, with no

[jira] [Created] (AIRFLOW-6944) Allow AWS DataSync to "catch up" when Task is already running

Bjorn Olsen created AIRFLOW-6944: Summary: Allow AWS DataSync to "catch up" when Task is already running Key: AIRFLOW-6944 URL: https://issues.apache.org/jira/browse/AIRFLOW-6944 Project: Apache

[jira] [Created] (AIRFLOW-6824) EMRAddStepsOperator does not work well with multi-step XCom

Bjorn Olsen created AIRFLOW-6824: Summary: EMRAddStepsOperator does not work well with multi-step XCom Key: AIRFLOW-6824 URL: https://issues.apache.org/jira/browse/AIRFLOW-6824 Project: Apache

[jira] [Created] (AIRFLOW-6822) AWS hooks dont always cache the boto3 client

Bjorn Olsen created AIRFLOW-6822: Summary: AWS hooks dont always cache the boto3 client Key: AIRFLOW-6822 URL: https://issues.apache.org/jira/browse/AIRFLOW-6822 Project: Apache Airflow

[jira] [Created] (AIRFLOW-6672) AWS DataSync - better logging of error message

Bjorn Olsen created AIRFLOW-6672: Summary: AWS DataSync - better logging of error message Key: AIRFLOW-6672 URL: https://issues.apache.org/jira/browse/AIRFLOW-6672 Project: Apache Airflow

[jira] [Created] (AIRFLOW-6654) AWS DataSync - bugfix when creating locations

Bjorn Olsen created AIRFLOW-6654: Summary: AWS DataSync - bugfix when creating locations Key: AIRFLOW-6654 URL: https://issues.apache.org/jira/browse/AIRFLOW-6654 Project: Apache Airflow

[jira] [Updated] (AIRFLOW-6400) pytest not working on Windows

[ https://issues.apache.org/jira/browse/AIRFLOW-6400?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bjorn Olsen updated AIRFLOW-6400: - Description: While Windows isn't supported I am using it to do development and testing. This

[jira] [Created] (AIRFLOW-6400) pytest not working on Windows

Bjorn Olsen created AIRFLOW-6400: Summary: pytest not working on Windows Key: AIRFLOW-6400 URL: https://issues.apache.org/jira/browse/AIRFLOW-6400 Project: Apache Airflow Issue Type: Bug

[jira] [Updated] (AIRFLOW-6366) Fix migrations for MS SQL Server

[ https://issues.apache.org/jira/browse/AIRFLOW-6366?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bjorn Olsen updated AIRFLOW-6366: - Description: Although MS SQL Server is not officially supported as a backend database, I am

[jira] [Created] (AIRFLOW-6366) Fix migrations for MS SQL Server

Bjorn Olsen created AIRFLOW-6366: Summary: Fix migrations for MS SQL Server Key: AIRFLOW-6366 URL: https://issues.apache.org/jira/browse/AIRFLOW-6366 Project: Apache Airflow Issue Type: Bug

[jira] [Updated] (AIRFLOW-6327) http_hook: Accept json= parameter for payload

[ https://issues.apache.org/jira/browse/AIRFLOW-6327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bjorn Olsen updated AIRFLOW-6327: - Summary: http_hook: Accept json= parameter for payload (was: http_hook: Add json requests

[jira] [Created] (AIRFLOW-6327) http_hook: Add json requests payload

Bjorn Olsen created AIRFLOW-6327: Summary: http_hook: Add json requests payload Key: AIRFLOW-6327 URL: https://issues.apache.org/jira/browse/AIRFLOW-6327 Project: Apache Airflow Issue Type:

[jira] [Commented] (AIRFLOW-6195) queued_dttm is "None" on UI, and not updated when tasks requeued

[ https://issues.apache.org/jira/browse/AIRFLOW-6195?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16990952#comment-16990952 ] Bjorn Olsen commented on AIRFLOW-6195: -- Turns out this actually affects several fields, due to

[jira] [Created] (AIRFLOW-6195) queued_dttm is "None" on UI, and not updated when tasks requeued

Bjorn Olsen created AIRFLOW-6195: Summary: queued_dttm is "None" on UI, and not updated when tasks requeued Key: AIRFLOW-6195 URL: https://issues.apache.org/jira/browse/AIRFLOW-6195 Project: Apache

[jira] [Closed] (AIRFLOW-6190) Task instances queued and dequeued before worker is ready, causing intermittently failed tasks

[ https://issues.apache.org/jira/browse/AIRFLOW-6190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bjorn Olsen closed AIRFLOW-6190. Resolution: Duplicate Closing as Duplicate > Task instances queued and dequeued before worker

[jira] [Commented] (AIRFLOW-6190) Task instances queued and dequeued before worker is ready, causing intermittently failed tasks

[ https://issues.apache.org/jira/browse/AIRFLOW-6190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16990843#comment-16990843 ] Bjorn Olsen commented on AIRFLOW-6190: -- [~kaxilnaik] , [~ash] I've done some testing and your PR

[jira] [Commented] (AIRFLOW-6190) Task instances queued and dequeued before worker is ready, causing intermittently failed tasks

[ https://issues.apache.org/jira/browse/AIRFLOW-6190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16990119#comment-16990119 ] Bjorn Olsen commented on AIRFLOW-6190: -- Thanks for the feedback guys. It does seem similar. Could

[jira] [Comment Edited] (AIRFLOW-6190) Task instances queued and dequeued before worker is ready, causing intermittently failed tasks

[ https://issues.apache.org/jira/browse/AIRFLOW-6190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16989735#comment-16989735 ] Bjorn Olsen edited comment on AIRFLOW-6190 at 12/6/19 1:02 PM: --- I changed

[jira] [Comment Edited] (AIRFLOW-6190) Task instances queued and dequeued before worker is ready, causing intermittently failed tasks

[ https://issues.apache.org/jira/browse/AIRFLOW-6190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16989735#comment-16989735 ] Bjorn Olsen edited comment on AIRFLOW-6190 at 12/6/19 12:59 PM: I

[jira] [Commented] (AIRFLOW-6190) Task instances queued and dequeued before worker is ready, causing intermittently failed tasks

[ https://issues.apache.org/jira/browse/AIRFLOW-6190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16989735#comment-16989735 ] Bjorn Olsen commented on AIRFLOW-6190: -- I changed the func to include a random duration sleep and

[jira] [Updated] (AIRFLOW-6190) Task instances queued and dequeued before worker is ready, causing intermittently failed tasks

[ https://issues.apache.org/jira/browse/AIRFLOW-6190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bjorn Olsen updated AIRFLOW-6190: - Description: Below dag creates 20 identical simple tasks which depend on each other in

[jira] [Updated] (AIRFLOW-6190) Task instances queued and dequeued before worker is ready, causing intermittently failed tasks

[ https://issues.apache.org/jira/browse/AIRFLOW-6190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bjorn Olsen updated AIRFLOW-6190: - Description: Below dag creates 20 identical simple tasks which depend on each other in

[jira] [Updated] (AIRFLOW-6190) Task instances queued and dequeued before worker is ready, causing intermittently failed tasks

[ https://issues.apache.org/jira/browse/AIRFLOW-6190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bjorn Olsen updated AIRFLOW-6190: - Description: Below dag creates 20 identical simple tasks which depend on each other in

[jira] [Updated] (AIRFLOW-6190) Task instances queued and dequeued before worker is ready, causing intermittently failed tasks

[ https://issues.apache.org/jira/browse/AIRFLOW-6190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bjorn Olsen updated AIRFLOW-6190: - Description: Below dag creates 20 identical simple tasks which depend on each other in

[jira] [Updated] (AIRFLOW-6190) Task instances queued and dequeued before worker is ready, causing intermittently failed tasks

[ https://issues.apache.org/jira/browse/AIRFLOW-6190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bjorn Olsen updated AIRFLOW-6190: - Description: Below dag creates 20 identical simple tasks which depend on each other in

[jira] [Updated] (AIRFLOW-6190) Task instances queued and dequeued before worker is ready, causing intermittently failed tasks

[ https://issues.apache.org/jira/browse/AIRFLOW-6190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bjorn Olsen updated AIRFLOW-6190: - Description: Below dag creates 20 identical simple tasks which depend on each other in

[jira] [Created] (AIRFLOW-6190) Task instances queued and dequeued before worker is ready, causing intermittently failed tasks

Bjorn Olsen created AIRFLOW-6190: Summary: Task instances queued and dequeued before worker is ready, causing intermittently failed tasks Key: AIRFLOW-6190 URL: https://issues.apache.org/jira/browse/AIRFLOW-6190

[jira] [Comment Edited] (AIRFLOW-6083) AwsLambdaHook is not accepting non-default configuration

[ https://issues.apache.org/jira/browse/AIRFLOW-6083?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16987709#comment-16987709 ] Bjorn Olsen edited comment on AIRFLOW-6083 at 12/4/19 10:15 AM: This

[jira] [Commented] (AIRFLOW-6083) AwsLambdaHook is not accepting non-default configuration

[ https://issues.apache.org/jira/browse/AIRFLOW-6083?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16987709#comment-16987709 ] Bjorn Olsen commented on AIRFLOW-6083: -- This should be resolved with AIRFLOW-6072 After this PR

[jira] [Assigned] (AIRFLOW-4355) Externally triggered DAG is marked as 'success' even if a task has been 'removed'!

[ https://issues.apache.org/jira/browse/AIRFLOW-4355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bjorn Olsen reassigned AIRFLOW-4355: Assignee: Bjorn Olsen > Externally triggered DAG is marked as 'success' even if a task

[jira] [Updated] (AIRFLOW-6170) BranchPythonOperator does not do XCom push of returned value

[ https://issues.apache.org/jira/browse/AIRFLOW-6170?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bjorn Olsen updated AIRFLOW-6170: - Description: BranchPythonOperator subclasses PythonOperator, and after it has selected a

[jira] [Updated] (AIRFLOW-6170) BranchPythonOperator does not do XCom push of returned value

[ https://issues.apache.org/jira/browse/AIRFLOW-6170?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bjorn Olsen updated AIRFLOW-6170: - Priority: Minor (was: Major) > BranchPythonOperator does not do XCom push of returned value >

[jira] [Updated] (AIRFLOW-6170) BranchPythonOperator does not do XCom push of returned value

[ https://issues.apache.org/jira/browse/AIRFLOW-6170?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bjorn Olsen updated AIRFLOW-6170: - Description: BranchPythonOperator subclasses PythonOperator and this means that after it has

[jira] [Updated] (AIRFLOW-6170) BranchPythonOperator does not do XCom push of returned value

[ https://issues.apache.org/jira/browse/AIRFLOW-6170?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bjorn Olsen updated AIRFLOW-6170: - Issue Type: Bug (was: Improvement) > BranchPythonOperator does not do XCom push of returned

[jira] [Updated] (AIRFLOW-6170) BranchPythonOperator does not do XCom push of returned value

[ https://issues.apache.org/jira/browse/AIRFLOW-6170?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bjorn Olsen updated AIRFLOW-6170: - Description: BranchPythonOperator subclasses PythonOperator and this means that after it has

[jira] [Created] (AIRFLOW-6170) BranchPythonOperator does not do XCom push of returned value

Bjorn Olsen created AIRFLOW-6170: Summary: BranchPythonOperator does not do XCom push of returned value Key: AIRFLOW-6170 URL: https://issues.apache.org/jira/browse/AIRFLOW-6170 Project: Apache

[jira] [Created] (AIRFLOW-6075) AWS Hook: Improve documentation

Bjorn Olsen created AIRFLOW-6075: Summary: AWS Hook: Improve documentation Key: AIRFLOW-6075 URL: https://issues.apache.org/jira/browse/AIRFLOW-6075 Project: Apache Airflow Issue Type:

[jira] [Updated] (AIRFLOW-6072) aws_hook: Ability to set outbound proxy

[ https://issues.apache.org/jira/browse/AIRFLOW-6072?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bjorn Olsen updated AIRFLOW-6072: - Description: The boto3 connection used by aws_hook does not respect outbound http_proxy

[jira] [Updated] (AIRFLOW-6072) aws_hook: Ability to set outbound proxy

[ https://issues.apache.org/jira/browse/AIRFLOW-6072?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bjorn Olsen updated AIRFLOW-6072: - Description: The boto3 connection used by aws_hook does not respect outbound http_proxy

[jira] [Updated] (AIRFLOW-6072) aws_hook: Ability to set outbound proxy

[ https://issues.apache.org/jira/browse/AIRFLOW-6072?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bjorn Olsen updated AIRFLOW-6072: - Priority: Minor (was: Major) > aws_hook: Ability to set outbound proxy >

[jira] [Created] (AIRFLOW-6072) aws_hook: Ability to set outbound proxy

Bjorn Olsen created AIRFLOW-6072: Summary: aws_hook: Ability to set outbound proxy Key: AIRFLOW-6072 URL: https://issues.apache.org/jira/browse/AIRFLOW-6072 Project: Apache Airflow Issue

[jira] [Created] (AIRFLOW-6038) AWS DataSync example dags

Bjorn Olsen created AIRFLOW-6038: Summary: AWS DataSync example dags Key: AIRFLOW-6038 URL: https://issues.apache.org/jira/browse/AIRFLOW-6038 Project: Apache Airflow Issue Type: Improvement

[jira] [Created] (AIRFLOW-5824) Add a new hook and operator for AWS DataSync

Bjorn Olsen created AIRFLOW-5824: Summary: Add a new hook and operator for AWS DataSync Key: AIRFLOW-5824 URL: https://issues.apache.org/jira/browse/AIRFLOW-5824 Project: Apache Airflow