[
https://issues.apache.org/jira/browse/AIRFLOW-5218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16907774#comment-16907774
]
Darren Weber commented on AIRFLOW-5218:
---
There is something weird in the polling logs. The
[
https://issues.apache.org/jira/browse/AIRFLOW-5218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16907749#comment-16907749
]
Darren Weber edited comment on AIRFLOW-5218 at 8/15/19 2:04 AM:
Even
Darren Weber created AIRFLOW-5218:
-
Summary: AWS Batch Operator - status polling too often, esp. for
high concurrency
Key: AIRFLOW-5218
URL: https://issues.apache.org/jira/browse/AIRFLOW-5218
[
https://issues.apache.org/jira/browse/AIRFLOW-5218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16907749#comment-16907749
]
Darren Weber edited comment on AIRFLOW-5218 at 8/15/19 2:15 AM:
PR at
[
https://issues.apache.org/jira/browse/AIRFLOW-5218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Darren Weber reassigned AIRFLOW-5218:
-
Assignee: Darren Weber
> AWS Batch Operator - status polling too often, esp. for high
[
https://issues.apache.org/jira/browse/AIRFLOW-5218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16907749#comment-16907749
]
Darren Weber commented on AIRFLOW-5218:
---
Even bumping the backoff factor from `0.1` to `0.3`
[
https://issues.apache.org/jira/browse/AIRFLOW-5218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Darren Weber updated AIRFLOW-5218:
--
Description:
The AWS Batch Operator attempts to use a boto3 feature that is not available
[
https://issues.apache.org/jira/browse/AIRFLOW-5218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Darren Weber updated AIRFLOW-5218:
--
Description:
The AWS Batch Operator attempts to use a boto3 feature that is not available
[
https://issues.apache.org/jira/browse/AIRFLOW-5576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Darren Weber updated AIRFLOW-5576:
--
Description:
While loading dags during a db-reset, before creating any DAG, some code
[
https://issues.apache.org/jira/browse/AIRFLOW-5576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Darren Weber updated AIRFLOW-5576:
--
Description:
While loading dags during a db-reset, before creating any DAG, some code
Darren Weber created AIRFLOW-5576:
-
Summary: relation "variable" does not exist - psycopg2 - DagBag
import
Key: AIRFLOW-5576
URL: https://issues.apache.org/jira/browse/AIRFLOW-5576
Project: Apache
[
https://issues.apache.org/jira/browse/AIRFLOW-5576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Darren Weber updated AIRFLOW-5576:
--
Description:
While loading dags during a db-reset, before creating any DAG, some code
[
https://issues.apache.org/jira/browse/AIRFLOW-5576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Darren Weber updated AIRFLOW-5576:
--
Description:
While loading dags during a db-reset, before creating any DAG, some code
[
https://issues.apache.org/jira/browse/AIRFLOW-5889?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Darren Weber updated AIRFLOW-5889:
--
Description:
The AWS Batch Operator attempts to use a boto3 feature that is not available
[
https://issues.apache.org/jira/browse/AIRFLOW-5889?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Darren Weber updated AIRFLOW-5889:
--
Description:
The AWS Batch Operator attempts to use a boto3 feature that is not available
[
https://issues.apache.org/jira/browse/AIRFLOW-5889?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Darren Weber updated AIRFLOW-5889:
--
Description:
The AWS Batch Operator attempts to use a boto3 feature that is not available
Darren Weber created AIRFLOW-5889:
-
Summary: AWS Batch Operator - API request limits should not fail a
task
Key: AIRFLOW-5889
URL: https://issues.apache.org/jira/browse/AIRFLOW-5889
Project: Apache
Darren Weber created AIRFLOW-6206:
-
Summary: Use a consistent `aws_` prefix for AWS contrib modules
Key: AIRFLOW-6206
URL: https://issues.apache.org/jira/browse/AIRFLOW-6206
Project: Apache Airflow
[
https://issues.apache.org/jira/browse/AIRFLOW-5889?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Darren Weber updated AIRFLOW-5889:
--
Affects Version/s: 1.10.2
1.10.3
1.10.4
[
https://issues.apache.org/jira/browse/AIRFLOW-5889?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Darren Weber updated AIRFLOW-5889:
--
Fix Version/s: 1.10.7
Affects Version/s: (was: 1.10.4)
[
https://issues.apache.org/jira/browse/AIRFLOW-5889?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Work on AIRFLOW-5889 started by Darren Weber.
-
> AWS Batch Operator - API request limits should not fail a task
>
[
https://issues.apache.org/jira/browse/AIRFLOW-5889?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16993128#comment-16993128
]
Darren Weber commented on AIRFLOW-5889:
---
Hope to get this into the next release for 1.10.x
-
[
https://issues.apache.org/jira/browse/AIRFLOW-5889?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Darren Weber updated AIRFLOW-5889:
--
Issue Type: Bug (was: Improvement)
> AWS Batch Operator - API request limits should not
[
https://issues.apache.org/jira/browse/AIRFLOW-5889?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Darren Weber updated AIRFLOW-5889:
--
Labels: AWS aws-batch (was: )
> AWS Batch Operator - API request limits should not fail a
[
https://issues.apache.org/jira/browse/AIRFLOW-5889?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Darren Weber updated AIRFLOW-5889:
--
Fix Version/s: (was: 1.10.6)
> AWS Batch Operator - API request limits should not fail a
[
https://issues.apache.org/jira/browse/AIRFLOW-6245?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Work on AIRFLOW-6245 stopped by Darren Weber.
-
> Allow custom waiters for AWS batch jobs
>
[
https://issues.apache.org/jira/browse/AIRFLOW-6245?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Work on AIRFLOW-6245 started by Darren Weber.
-
> Allow custom waiters for AWS batch jobs
>
[
https://issues.apache.org/jira/browse/AIRFLOW-6245?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Darren Weber updated AIRFLOW-6245:
--
Description:
The botocore waiter for AWS batch jobs has not been merged and released for
Darren Weber created AIRFLOW-6245:
-
Summary: Allow custom waiters for AWS batch jobs
Key: AIRFLOW-6245
URL: https://issues.apache.org/jira/browse/AIRFLOW-6245
Project: Apache Airflow
Issue
[
https://issues.apache.org/jira/browse/AIRFLOW-6211?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Darren Weber resolved AIRFLOW-6211.
---
Resolution: Fixed
> Document using conda virtualenv for development
>
[
https://issues.apache.org/jira/browse/AIRFLOW-6245?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Darren Weber reassigned AIRFLOW-6245:
-
Assignee: Darren Weber
> Allow custom waiters for AWS batch jobs
>
[
https://issues.apache.org/jira/browse/AIRFLOW-6245?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Work on AIRFLOW-6245 started by Darren Weber.
-
> Allow custom waiters for AWS batch jobs
>
[
https://issues.apache.org/jira/browse/AIRFLOW-6245?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Darren Weber updated AIRFLOW-6245:
--
Description:
The botocore waiter for AWS batch jobs has not been merged and released for
[
https://issues.apache.org/jira/browse/AIRFLOW-6206?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Darren Weber updated AIRFLOW-6206:
--
Fix Version/s: 1.10.7
2.0.0
Description: Migrate AWS batch operator
[
https://issues.apache.org/jira/browse/AIRFLOW-6206?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Work on AIRFLOW-6206 started by Darren Weber.
-
> Adapt AWS batch operator to AIP-21
> --
>
Darren Weber created AIRFLOW-6322:
-
Summary: Add pytest marker for slow tests
Key: AIRFLOW-6322
URL: https://issues.apache.org/jira/browse/AIRFLOW-6322
Project: Apache Airflow
Issue Type:
Darren Weber created AIRFLOW-6321:
-
Summary: Revise operators and hooks documentation layout
Key: AIRFLOW-6321
URL: https://issues.apache.org/jira/browse/AIRFLOW-6321
Project: Apache Airflow
[
https://issues.apache.org/jira/browse/AIRFLOW-6322?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Work on AIRFLOW-6322 started by Darren Weber.
-
> Add pytest marker for slow tests
>
>
>
[
https://issues.apache.org/jira/browse/AIRFLOW-6321?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Darren Weber updated AIRFLOW-6321:
--
Description:
In
Darren Weber created AIRFLOW-6211:
-
Summary: Document using conda virtualenv for development
Key: AIRFLOW-6211
URL: https://issues.apache.org/jira/browse/AIRFLOW-6211
Project: Apache Airflow
[
https://issues.apache.org/jira/browse/AIRFLOW-6211?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Darren Weber reassigned AIRFLOW-6211:
-
Assignee: Darren Weber
> Document using conda virtualenv for development
>
[
https://issues.apache.org/jira/browse/AIRFLOW-4796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17020790#comment-17020790
]
Darren Weber edited comment on AIRFLOW-4796 at 1/22/20 5:41 AM:
Also
[
https://issues.apache.org/jira/browse/AIRFLOW-4796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17020790#comment-17020790
]
Darren Weber commented on AIRFLOW-4796:
---
It might also help to ask for help among the dask
[
https://issues.apache.org/jira/browse/AIRFLOW-4796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17006987#comment-17006987
]
Darren Weber edited comment on AIRFLOW-4796 at 1/2/20 5:55 PM:
---
I don't
[
https://issues.apache.org/jira/browse/AIRFLOW-4796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17006987#comment-17006987
]
Darren Weber commented on AIRFLOW-4796:
---
I don't know enough to propose any implementation
[
https://issues.apache.org/jira/browse/AIRFLOW-6245?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Darren Weber updated AIRFLOW-6245:
--
Fix Version/s: 1.10.8
2.0.0
> Allow custom waiters for AWS batch jobs
>
Darren Weber created AIRFLOW-6395:
-
Summary: Add AsyncExecutor option
Key: AIRFLOW-6395
URL: https://issues.apache.org/jira/browse/AIRFLOW-6395
Project: Apache Airflow
Issue Type:
[
https://issues.apache.org/jira/browse/AIRFLOW-6395?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Darren Weber updated AIRFLOW-6395:
--
Summary: [AIP-28] Add AsyncExecutor option (was: Add AsyncExecutor option)
> [AIP-28] Add
[
https://issues.apache.org/jira/browse/AIRFLOW-6395?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Darren Weber updated AIRFLOW-6395:
--
Description:
Add an AsyncExecutor that is similar to LocalExecutor but designed to optimize
49 matches
Mail list logo
