[jira] [Commented] (AIRFLOW-5071) Thousand os Executor reports task instance X finished (success) although the task says its queued. Was the task killed externally?

2022-03-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17506007#comment-17506007 ] ASF GitHub Bot commented on AIRFLOW-5071: - ghostbody commented on issue #10790: URL:

[GitHub] [airflow] ghostbody commented on issue #10790: Copy of [AIRFLOW-5071] JIRA: Thousands of Executor reports task instance X finished (success) although the task says its queued. Was the task ki

2022-03-13 Thread GitBox
ghostbody commented on issue #10790: URL: https://github.com/apache/airflow/issues/10790#issuecomment-1066406484 @turbaszek Let me make a PR later~ We are doing pressure tests these days and this problem had appeared often. -- This is an automated message from the Apache Git Service.

[GitHub] [airflow] dstandish commented on a change in pull request #22102: Enhance `db upgrade` args

2022-03-13 Thread GitBox
dstandish commented on a change in pull request #22102: URL: https://github.com/apache/airflow/pull/22102#discussion_r825605446 ## File path: airflow/cli/cli_parser.py ## @@ -516,18 +516,32 @@ def string_list_type(val): type=int, default=60, ) -ARG_DB_VERSION = Arg(

[GitHub] [airflow] nitinmahawadiwar edited a comment on issue #22007: Add Variable, Connection "description" fields available in the API

2022-03-13 Thread GitBox
nitinmahawadiwar edited a comment on issue #22007: URL: https://github.com/apache/airflow/issues/22007#issuecomment-1066142969 Hello @potiuk @eladkal , I am able to return the description field from get variable api, also found the places to update documentation

[GitHub] [airflow] dstandish commented on a change in pull request #22184: WIP - Add run_id and map_index to SlaMiss

2022-03-13 Thread GitBox
dstandish commented on a change in pull request #22184: URL: https://github.com/apache/airflow/pull/22184#discussion_r825594340 ## File path: airflow/dag_processing/processor.py ## @@ -375,21 +376,16 @@ def manage_slas(self, dag: DAG, session: Session = None) -> None:

[GitHub] [airflow] dstandish commented on a change in pull request #22184: WIP - Add run_id and map_index to SlaMiss

2022-03-13 Thread GitBox
dstandish commented on a change in pull request #22184: URL: https://github.com/apache/airflow/pull/22184#discussion_r825593332 ## File path: airflow/models/taskinstance.py ## @@ -425,6 +425,16 @@ class TaskInstance(Base, LoggingMixin): dag_run = relationship("DagRun",

[GitHub] [airflow] Bowrna commented on a change in pull request #22217: added docs about detailed network and constraints information

2022-03-13 Thread GitBox
Bowrna commented on a change in pull request #22217: URL: https://github.com/apache/airflow/pull/22217#discussion_r825570397 ## File path: airflow/providers/docker/operators/docker_swarm.py ## @@ -86,8 +86,19 @@ class DockerSwarmOperator(DockerOperator): :param mode:

[GitHub] [airflow] fatmumuhomer opened a new issue #22238: Option to display Last Run and Next Run based on data_interval_end

2022-03-13 Thread GitBox
fatmumuhomer opened a new issue #22238: URL: https://github.com/apache/airflow/issues/22238 ### Description Currently the DAGs view shows the Last Run and Next Run values using the data_interval_start. The full data interval information is available if the user hovers over the

[GitHub] [airflow] edithturn edited a comment on issue #19971: CI: Rewrite selective check script in Python

2022-03-13 Thread GitBox
edithturn edited a comment on issue #19971: URL: https://github.com/apache/airflow/issues/19971#issuecomment-1066266872 Thank you @potiuk , I will ping you Tuesday, Poland Time.  ⏲️ -- This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [airflow] edithturn commented on issue #19971: CI: Rewrite selective check script in Python

2022-03-13 Thread GitBox
edithturn commented on issue #19971: URL: https://github.com/apache/airflow/issues/19971#issuecomment-1066266872 Thank you Jarek, I will ping you Tuesday, Poland Time.  ⏲️ -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

[GitHub] [airflow] potiuk commented on issue #19971: CI: Rewrite selective check script in Python

2022-03-13 Thread GitBox
potiuk commented on issue #19971: URL: https://github.com/apache/airflow/issues/19971#issuecomment-1066264966 Tuesday is fine. I will be mostly out since Wed though. On Mon, Mar 14, 2022 at 2:59 AM Edith Puclla ***@***.***> wrote: > @potiuk do

[GitHub] [airflow] boring-cyborg[bot] commented on pull request #22236: Addressed some issues in the tutorial mentioned in discussion #22233

2022-03-13 Thread GitBox
boring-cyborg[bot] commented on pull request #22236: URL: https://github.com/apache/airflow/pull/22236#issuecomment-1066260971 Congratulations on your first Pull Request and welcome to the Apache Airflow community! If you have any issues or are unsure about any anything please check our

[GitHub] [airflow] MattTriano opened a new pull request #22236: Addressed some issues in the tutorial mentioned in discussion #22233

2022-03-13 Thread GitBox
MattTriano opened a new pull request #22236: URL: https://github.com/apache/airflow/pull/22236 While working through the tutorial, some parts seemed a bit unclear or incorrect, which took me to issue #18950 ( converted into discussion #22233 about 15 minutes ago). I had already resolved

[GitHub] [airflow] edithturn commented on issue #19971: CI: Rewrite selective check script in Python

2022-03-13 Thread GitBox
edithturn commented on issue #19971: URL: https://github.com/apache/airflow/issues/19971#issuecomment-1066260099 @potiuk do you have 10 minutes to discuss this a little bit? Maybe Tuesday? I will bring some ideas and we can split to start to work on it.  -- This is an automated

[airflow] branch main updated: Issue 20453 - Fixes the test_http and test_sheets assert calls only (#22104)

2022-03-13 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new 3931394 Issue 20453 - Fixes the test_http and

[GitHub] [airflow] potiuk merged pull request #22104: Issue 20453 - Fixes the test_http and test_sheets assert calls only

2022-03-13 Thread GitBox
potiuk merged pull request #22104: URL: https://github.com/apache/airflow/pull/22104 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] potiuk commented on pull request #20147: clean up temp files correctly when using impersonation

2022-03-13 Thread GitBox
potiuk commented on pull request #20147: URL: https://github.com/apache/airflow/pull/20147#issuecomment-1066257530 Checks + docs are failing though -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[GitHub] [airflow] potiuk commented on pull request #20377: Dataplex operators

2022-03-13 Thread GitBox
potiuk commented on pull request #20377: URL: https://github.com/apache/airflow/pull/20377#issuecomment-1066248962 It needs at least rebase and checking if the errors were accidental. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [airflow] potiuk commented on issue #22160: Directly submitting task to executor doesn't set `queued_dttm` which can cause scheduler crashloop

2022-03-13 Thread GitBox
potiuk commented on issue #22160: URL: https://github.com/apache/airflow/issues/22160#issuecomment-1066234187 Agree. This is a valid case and solution 3. seems to be best. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

[GitHub] [airflow] potiuk edited a comment on pull request #21539: Filter out default configs when overrides exist.

2022-03-13 Thread GitBox
potiuk edited a comment on pull request #21539: URL: https://github.com/apache/airflow/pull/21539#issuecomment-1066233262 After looking agian - I think what is also missing here is a bit "user" description in the https://airflow.apache.org/docs/apache-airflow/stable/howto/set-config.html

[GitHub] [airflow] potiuk commented on pull request #21539: Filter out default configs when overrides exist.

2022-03-13 Thread GitBox
potiuk commented on pull request #21539: URL: https://github.com/apache/airflow/pull/21539#issuecomment-1066233262 After looking agian - I think what is also missing here is a bit "user" description in the https://airflow.apache.org/docs/apache-airflow/stable/howto/set-config.html

[GitHub] [airflow] uranusjr commented on issue #20884: JSONDecodeError caused by incomplete JSON created by cat /airflow/xcom/return.json when using KubernetePodOperator

2022-03-13 Thread GitBox
uranusjr commented on issue #20884: URL: https://github.com/apache/airflow/issues/20884#issuecomment-1066225166 They say you need to file to https://github.com/kubernetes-client/python instead. -- This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [airflow] uranusjr commented on a change in pull request #22227: Masking extras in GET /connections/ endpoint

2022-03-13 Thread GitBox
uranusjr commented on a change in pull request #7: URL: https://github.com/apache/airflow/pull/7#discussion_r825528294 ## File path: airflow/api_connexion/schemas/connection_schema.py ## @@ -44,7 +46,30 @@ class ConnectionSchema(ConnectionCollectionItemSchema):

[GitHub] [airflow] uranusjr commented on a change in pull request #22231: S3 list key filter

2022-03-13 Thread GitBox
uranusjr commented on a change in pull request #22231: URL: https://github.com/apache/airflow/pull/22231#discussion_r825527820 ## File path: airflow/providers/amazon/aws/hooks/s3.py ## @@ -255,6 +256,23 @@ def list_prefixes( return prefixes +def

[GitHub] [airflow] github-actions[bot] commented on issue #17975: Backfill blocks all tasks from being queued when a single pool is full.

2022-03-13 Thread GitBox
github-actions[bot] commented on issue #17975: URL: https://github.com/apache/airflow/issues/17975#issuecomment-1066214696 This issue has been automatically marked as stale because it has been open for 30 days with no response from the author. It will be closed in next 7 days if no

[GitHub] [airflow] sunank200 opened a new pull request #22231: S3 list key filter

2022-03-13 Thread GitBox
sunank200 opened a new pull request #22231: URL: https://github.com/apache/airflow/pull/22231 Implemented as discussed in [closed PR](https://github.com/apache/airflow/pull/19018). Add more filter options to list_keys of S3Hook - `start_after_key`: should return only keys greater

[GitHub] [airflow] potiuk commented on a change in pull request #22102: Enhance `db upgrade` args

2022-03-13 Thread GitBox
potiuk commented on a change in pull request #22102: URL: https://github.com/apache/airflow/pull/22102#discussion_r825520725 ## File path: airflow/cli/cli_parser.py ## @@ -516,18 +516,32 @@ def string_list_type(val): type=int, default=60, ) -ARG_DB_VERSION = Arg(

[airflow] branch main updated (12e9e2c -> 6f8f535)

2022-03-13 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git. from 12e9e2c Databricks hook - retry on HTTP Status 429 as well (#21852) add 6f8f535 Add sample dags and update doc

[GitHub] [airflow] potiuk merged pull request #22128: Add sample dags and update doc for RedshiftClusterSensor, RedshiftPau…

2022-03-13 Thread GitBox
potiuk merged pull request #22128: URL: https://github.com/apache/airflow/pull/22128 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] uranusjr commented on issue #22152: render_template_as_native_obj=True in DAG constructor prevents failure e-mail from sending

2022-03-13 Thread GitBox
uranusjr commented on issue #22152: URL: https://github.com/apache/airflow/issues/22152#issuecomment-1066206647 Please also see #22218 for some context. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

[GitHub] [airflow] github-actions[bot] commented on pull request #22226: Add documentation for RC2 package release for Feb 2022

2022-03-13 Thread GitBox
github-actions[bot] commented on pull request #6: URL: https://github.com/apache/airflow/pull/6#issuecomment-1066206473 The PR is likely OK to be merged with just subset of tests for default Python and Database versions without running the full matrix of tests, because it does not

[GitHub] [airflow] potiuk commented on pull request #19736: Add Databricks Deferrable Operators

2022-03-13 Thread GitBox
potiuk commented on pull request #19736: URL: https://github.com/apache/airflow/pull/19736#issuecomment-1066204353 Some changes are merged so the conflicts need to be resolved. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

[airflow] branch main updated: Databricks hook - retry on HTTP Status 429 as well (#21852)

2022-03-13 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new 12e9e2c Databricks hook - retry on HTTP Status

[GitHub] [airflow] potiuk merged pull request #21852: Databricks hook - retry on HTTP Status 429 as well

2022-03-13 Thread GitBox
potiuk merged pull request #21852: URL: https://github.com/apache/airflow/pull/21852 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] potiuk closed issue #21559: Databricks hook: Retry also on HTTP Status 429 - rate limit exceeded

2022-03-13 Thread GitBox
potiuk closed issue #21559: URL: https://github.com/apache/airflow/issues/21559 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] boring-cyborg[bot] commented on issue #22228: Installing Apache Hive provider package results in sasl error

2022-03-13 Thread GitBox
boring-cyborg[bot] commented on issue #8: URL: https://github.com/apache/airflow/issues/8#issuecomment-1066197295 Thanks for opening your first issue here! Be sure to follow the issue template! -- This is an automated message from the Apache Git Service. To respond to the

[GitHub] [airflow] klazaj opened a new issue #22228: Installing Apache Hive provider package results in sasl error

2022-03-13 Thread GitBox
klazaj opened a new issue #8: URL: https://github.com/apache/airflow/issues/8 ### Apache Airflow version 2.2.4 (latest released) ### What happened I'm trying to add Hive Connection using the apache-hive provider from airflow. `RUN pip3 install

[GitHub] [airflow] SamWheating opened a new pull request #22227: Masking extras in GET /connections/ endpoint

2022-03-13 Thread GitBox
SamWheating opened a new pull request #7: URL: https://github.com/apache/airflow/pull/7 Applying secrets masking when reading the `extras` field of a connection via the REST API. Users can still update the extras with the `patch` or `post` endpoints, but when reading them

[GitHub] [airflow] potiuk commented on pull request #22226: Add documentation for RC2 package release for Feb 2022

2022-03-13 Thread GitBox
potiuk commented on pull request #6: URL: https://github.com/apache/airflow/pull/6#issuecomment-1066192737 Docs for RC2 of Feb providers: * amazon and dbt.cloud - bug fixes * snowflake and databricks- Upcoming Python 3.10-related changes -- This is an automated

[GitHub] [airflow] potiuk opened a new pull request #22226: Add documentation for RC2 package release for Feb 2022

2022-03-13 Thread GitBox
potiuk opened a new pull request #6: URL: https://github.com/apache/airflow/pull/6 --- **^ Add meaningful description above** Read the **[Pull Request Guidelines](https://github.com/apache/airflow/blob/main/CONTRIBUTING.rst#pull-request-guidelines)** for more

[GitHub] [airflow] ulsc commented on a change in pull request #22219: Gdrive upload operator

2022-03-13 Thread GitBox
ulsc commented on a change in pull request #22219: URL: https://github.com/apache/airflow/pull/22219#discussion_r825503425 ## File path: airflow/providers/google/suite/operators/drive.py ## @@ -0,0 +1,115 @@ +# Licensed to the Apache Software Foundation (ASF) under one +# or

[GitHub] [airflow] potiuk commented on pull request #22204: Add description on the vendoring process we use

2022-03-13 Thread GitBox
potiuk commented on pull request #22204: URL: https://github.com/apache/airflow/pull/22204#issuecomment-1066180414 First in-line to get finally Python 3.10 support :) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use

[GitHub] [airflow] potiuk opened a new pull request #22225: Optimize Multiplatform cache builds

2022-03-13 Thread GitBox
potiuk opened a new pull request #5: URL: https://github.com/apache/airflow/pull/5 This PR starts an ARM EC2 instance and forwards socket via SSH so that it can be used by docker buildx build with airflow_cache multi-platform builders. The instance is created only when

[GitHub] [airflow] ephraimbuddy commented on issue #21951: Tasks stuck in scheduled state from different dags waiting for other dag tasks to complete first

2022-03-13 Thread GitBox
ephraimbuddy commented on issue #21951: URL: https://github.com/apache/airflow/issues/21951#issuecomment-1066179851 > > max_active_tasks_per_dag == dag_concurrency. > > There was a rename of dag_concurrency to max_active_tasks_per_dag. Can you set this correctly? > >

[GitHub] [airflow] ephraimbuddy commented on issue #22059: DagBag import timeout while retrieving variable

2022-03-13 Thread GitBox
ephraimbuddy commented on issue #22059: URL: https://github.com/apache/airflow/issues/22059#issuecomment-1066179734 > Yes variable is there. This is happening intermittently. Can you follow this best practice for variables:

[GitHub] [airflow] ulsc commented on a change in pull request #22219: Gdrive upload operator

2022-03-13 Thread GitBox
ulsc commented on a change in pull request #22219: URL: https://github.com/apache/airflow/pull/22219#discussion_r825502086 ## File path: airflow/providers/google/suite/operators/drive.py ## @@ -0,0 +1,115 @@ +# Licensed to the Apache Software Foundation (ASF) under one +# or

[GitHub] [airflow] ulsc commented on a change in pull request #22219: Gdrive upload operator

2022-03-13 Thread GitBox
ulsc commented on a change in pull request #22219: URL: https://github.com/apache/airflow/pull/22219#discussion_r825502032 ## File path: airflow/providers/google/suite/operators/drive.py ## @@ -0,0 +1,115 @@ +# Licensed to the Apache Software Foundation (ASF) under one +# or

[GitHub] [airflow] ulsc commented on a change in pull request #22219: Gdrive upload operator

2022-03-13 Thread GitBox
ulsc commented on a change in pull request #22219: URL: https://github.com/apache/airflow/pull/22219#discussion_r825501469 ## File path: airflow/providers/google/suite/operators/drive.py ## @@ -0,0 +1,115 @@ +# Licensed to the Apache Software Foundation (ASF) under one +# or

[GitHub] [airflow] ephraimbuddy closed issue #22096: Status of testing of Apache Airflow Helm Chart 1.5.0rc2

2022-03-13 Thread GitBox
ephraimbuddy closed issue #22096: URL: https://github.com/apache/airflow/issues/22096 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] ephraimbuddy commented on issue #22096: Status of testing of Apache Airflow Helm Chart 1.5.0rc2

2022-03-13 Thread GitBox
ephraimbuddy commented on issue #22096: URL: https://github.com/apache/airflow/issues/22096#issuecomment-1066177479 Thanks, everyone, 1.5.0 has been released -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[GitHub] [airflow] ulsc commented on a change in pull request #22219: Gdrive upload operator

2022-03-13 Thread GitBox
ulsc commented on a change in pull request #22219: URL: https://github.com/apache/airflow/pull/22219#discussion_r825500406 ## File path: airflow/providers/google/suite/operators/drive.py ## @@ -0,0 +1,115 @@ +# Licensed to the Apache Software Foundation (ASF) under one +# or

[airflow] branch constraints-main updated: Updating constraints. Build id:1977305453

2022-03-13 Thread github-bot
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a commit to branch constraints-main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/constraints-main by this push: new 83ddc73 Updating

[GitHub] [airflow] kyan113 commented on issue #22152: render_template_as_native_obj=True in DAG constructor prevents failure e-mail from sending

2022-03-13 Thread GitBox
kyan113 commented on issue #22152: URL: https://github.com/apache/airflow/issues/22152#issuecomment-1066172041 If you'd like. I don't think I have the expertise to put together a pull request, so someone else will need to take a crack at it. -- This is an automated message from the

[airflow] branch main updated (af9d85c -> c108f26)

2022-03-13 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git. from af9d85c Skip some tests for Databricks from running on Python 3.10 (#1) add c108f26 Change the default

[GitHub] [airflow] potiuk merged pull request #22222: Make `chunk_size` in `GoogleDriveHook` standard

2022-03-13 Thread GitBox
potiuk merged pull request #2: URL: https://github.com/apache/airflow/pull/2 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] github-actions[bot] commented on pull request #22222: Make `chunk_size` in `GoogleDriveHook` standard

2022-03-13 Thread GitBox
github-actions[bot] commented on pull request #2: URL: https://github.com/apache/airflow/pull/2#issuecomment-1066163363 The PR is likely OK to be merged with just subset of tests for default Python and Database versions without running the full matrix of tests, because it does not

[GitHub] [airflow] turbaszek commented on a change in pull request #22219: Gdrive upload operator

2022-03-13 Thread GitBox
turbaszek commented on a change in pull request #22219: URL: https://github.com/apache/airflow/pull/22219#discussion_r825490843 ## File path: airflow/providers/google/suite/operators/drive.py ## @@ -0,0 +1,115 @@ +# Licensed to the Apache Software Foundation (ASF) under one +#

[GitHub] [airflow] turbaszek commented on a change in pull request #22219: Gdrive upload operator

2022-03-13 Thread GitBox
turbaszek commented on a change in pull request #22219: URL: https://github.com/apache/airflow/pull/22219#discussion_r825490555 ## File path: airflow/providers/google/suite/operators/drive.py ## @@ -0,0 +1,115 @@ +# Licensed to the Apache Software Foundation (ASF) under one +#

[GitHub] [airflow] turbaszek commented on a change in pull request #22219: Gdrive upload operator

2022-03-13 Thread GitBox
turbaszek commented on a change in pull request #22219: URL: https://github.com/apache/airflow/pull/22219#discussion_r825490457 ## File path: airflow/providers/google/suite/operators/drive.py ## @@ -0,0 +1,115 @@ +# Licensed to the Apache Software Foundation (ASF) under one +#

[GitHub] [airflow] turbaszek commented on a change in pull request #22219: Gdrive upload operator

2022-03-13 Thread GitBox
turbaszek commented on a change in pull request #22219: URL: https://github.com/apache/airflow/pull/22219#discussion_r825490206 ## File path: airflow/providers/google/suite/operators/drive.py ## @@ -0,0 +1,115 @@ +# Licensed to the Apache Software Foundation (ASF) under one +#

[GitHub] [airflow] turbaszek commented on a change in pull request #22219: Gdrive upload operator

2022-03-13 Thread GitBox
turbaszek commented on a change in pull request #22219: URL: https://github.com/apache/airflow/pull/22219#discussion_r825490158 ## File path: airflow/providers/google/suite/operators/drive.py ## @@ -0,0 +1,115 @@ +# Licensed to the Apache Software Foundation (ASF) under one +#

[GitHub] [airflow] Tonkonozhenko opened a new issue #22224: Task runs second time after success

2022-03-13 Thread GitBox
Tonkonozhenko opened a new issue #4: URL: https://github.com/apache/airflow/issues/4 ### Apache Airflow version 2.2.4 (latest released) ### What happened Task runs a second time after a first successful run. In logs I see suspicious line: ```

[GitHub] [airflow] potiuk closed pull request #22050: Add Python 3.10 support

2022-03-13 Thread GitBox
potiuk closed pull request #22050: URL: https://github.com/apache/airflow/pull/22050 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] likecodingloveproblems edited a comment on issue #22152: render_template_as_native_obj=True in DAG constructor prevents failure e-mail from sending

2022-03-13 Thread GitBox
likecodingloveproblems edited a comment on issue #22152: URL: https://github.com/apache/airflow/issues/22152#issuecomment-1066153902 Would I work on this issue please? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use

[GitHub] [airflow] likecodingloveproblems commented on issue #22152: render_template_as_native_obj=True in DAG constructor prevents failure e-mail from sending

2022-03-13 Thread GitBox
likecodingloveproblems commented on issue #22152: URL: https://github.com/apache/airflow/issues/22152#issuecomment-1066153902 Would I work on this issue? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

[airflow] branch constraints-main updated: Updating constraints. Build id:1976939596

2022-03-13 Thread github-bot
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a commit to branch constraints-main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/constraints-main by this push: new 0cf1688 Updating

[GitHub] [airflow] ddelange commented on issue #20884: JSONDecodeError caused by incomplete JSON created by cat /airflow/xcom/return.json when using KubernetePodOperator

2022-03-13 Thread GitBox
ddelange commented on issue #20884: URL: https://github.com/apache/airflow/issues/20884#issuecomment-1066146827 FYI, the upstream issue has been closed, as the repo was archived -- This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [airflow] nitinmahawadiwar commented on issue #22007: Add Variable, Connection "description" fields available in the API

2022-03-13 Thread GitBox
nitinmahawadiwar commented on issue #22007: URL: https://github.com/apache/airflow/issues/22007#issuecomment-1066142969 Hello @potiuk @eladkal , I am able to return the description field from get api, also found the places to update documentation (verifying locally) but somehow not able

[GitHub] [airflow] ulsc commented on pull request #22222: Make `chunk_size` in `GoogleDriveHook` standard

2022-03-13 Thread GitBox
ulsc commented on pull request #2: URL: https://github.com/apache/airflow/pull/2#issuecomment-1066141472 @potiuk this is the mentioned change from the "chunk size" discussion. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to

[airflow] branch main updated: Skip some tests for Databricks from running on Python 3.10 (#22221)

2022-03-13 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new af9d85c Skip some tests for Databricks from

[GitHub] [airflow] potiuk merged pull request #22221: Skip some tests for Databricks from running on Python 3.10

2022-03-13 Thread GitBox
potiuk merged pull request #1: URL: https://github.com/apache/airflow/pull/1 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] alexott opened a new pull request #22223: DatabricksSqlOperator - switch to databricks-sql-connector 2.x

2022-03-13 Thread GitBox
alexott opened a new pull request #3: URL: https://github.com/apache/airflow/pull/3 Initial work to switch to databricks-sql-connector 2.x in Databricks SQL Operators -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

[GitHub] [airflow] ulsc opened a new pull request #22222: Make `chunk_size` in `GoogleDriveHook` standard

2022-03-13 Thread GitBox
ulsc opened a new pull request #2: URL: https://github.com/apache/airflow/pull/2 Change the default `chunk_size` to a clear representation & add documentation -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use

[GitHub] [airflow] ulsc commented on a change in pull request #22219: Gdrive upload operator

2022-03-13 Thread GitBox
ulsc commented on a change in pull request #22219: URL: https://github.com/apache/airflow/pull/22219#discussion_r825468633 ## File path: airflow/providers/google/suite/operators/drive.py ## @@ -0,0 +1,116 @@ +# Licensed to the Apache Software Foundation (ASF) under one +# or

[GitHub] [airflow] eladkal commented on a change in pull request #22219: Gdrive upload operator

2022-03-13 Thread GitBox
eladkal commented on a change in pull request #22219: URL: https://github.com/apache/airflow/pull/22219#discussion_r825468164 ## File path: airflow/providers/google/suite/operators/drive.py ## @@ -0,0 +1,116 @@ +# Licensed to the Apache Software Foundation (ASF) under one +#

[GitHub] [airflow] eladkal commented on a change in pull request #22219: Gdrive upload operator

2022-03-13 Thread GitBox
eladkal commented on a change in pull request #22219: URL: https://github.com/apache/airflow/pull/22219#discussion_r825468164 ## File path: airflow/providers/google/suite/operators/drive.py ## @@ -0,0 +1,116 @@ +# Licensed to the Apache Software Foundation (ASF) under one +#

[GitHub] [airflow] github-actions[bot] commented on pull request #22221: Skip some tests for Databricks from running on Python 3.10

2022-03-13 Thread GitBox
github-actions[bot] commented on pull request #1: URL: https://github.com/apache/airflow/pull/1#issuecomment-1066126192 The PR is likely OK to be merged with just subset of tests for default Python and Database versions without running the full matrix of tests, because it does not

[GitHub] [airflow] potiuk closed pull request #22206: Add cgroupspy to _vendor folder

2022-03-13 Thread GitBox
potiuk closed pull request #22206: URL: https://github.com/apache/airflow/pull/22206 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] ulsc commented on a change in pull request #22219: Gdrive upload operator

2022-03-13 Thread GitBox
ulsc commented on a change in pull request #22219: URL: https://github.com/apache/airflow/pull/22219#discussion_r825462049 ## File path: airflow/providers/google/suite/operators/drive.py ## @@ -0,0 +1,116 @@ +# Licensed to the Apache Software Foundation (ASF) under one +# or

[GitHub] [airflow] eladkal commented on a change in pull request #22219: Gdrive upload operator

2022-03-13 Thread GitBox
eladkal commented on a change in pull request #22219: URL: https://github.com/apache/airflow/pull/22219#discussion_r825461523 ## File path: airflow/providers/google/suite/operators/drive.py ## @@ -0,0 +1,116 @@ +# Licensed to the Apache Software Foundation (ASF) under one +#

[GitHub] [airflow] eladkal commented on a change in pull request #22219: Gdrive upload operator

2022-03-13 Thread GitBox
eladkal commented on a change in pull request #22219: URL: https://github.com/apache/airflow/pull/22219#discussion_r825461523 ## File path: airflow/providers/google/suite/operators/drive.py ## @@ -0,0 +1,116 @@ +# Licensed to the Apache Software Foundation (ASF) under one +#

[GitHub] [airflow] potiuk commented on pull request #22221: Skip some tests for Databricks from running on Python 3.10

2022-03-13 Thread GitBox
potiuk commented on pull request #1: URL: https://github.com/apache/airflow/pull/1#issuecomment-1066119933 cc: @alexott -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [airflow] potiuk opened a new pull request #22221: Skip some tests for Databricks from running on Python 3.10

2022-03-13 Thread GitBox
potiuk opened a new pull request #1: URL: https://github.com/apache/airflow/pull/1 This is a temporary measure until the Databricks SQL library is released in Python 3.10 - compatible version. Related to: #0 --- **^ Add meaningful description above**

[GitHub] [airflow] potiuk commented on issue #22220: Databricks SQL fails on Python 3.10

2022-03-13 Thread GitBox
potiuk commented on issue #0: URL: https://github.com/apache/airflow/issues/0#issuecomment-1066119096 cc: @alexott - I created an issue to track it (and proceed with excluding the failing test in Python 3.10 for now so that it does not block us from enabling 3.10 for Airflow main

[GitHub] [airflow] potiuk opened a new issue #22220: Databricks SQL fails on Python 3.10

2022-03-13 Thread GitBox
potiuk opened a new issue #0: URL: https://github.com/apache/airflow/issues/0 ### Apache Airflow Provider(s) databricks ### Versions of Apache Airflow Providers The databricks SQL does not work on Python 3.10 due to "from collections import Iterable" in the

[GitHub] [airflow] ulsc opened a new pull request #22219: Gdrive upload operator

2022-03-13 Thread GitBox
ulsc opened a new pull request #22219: URL: https://github.com/apache/airflow/pull/22219 Operator to upload a list of files to a Google Drive folder, alongside a file which can be used to have more Google Drive operators. -- This is an automated message from the Apache Git Service. To

[airflow] tag constraints-2.2.0 updated (ac1121b -> 7cae736)

2022-03-13 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a change to tag constraints-2.2.0 in repository https://gitbox.apache.org/repos/asf/airflow.git. *** WARNING: tag constraints-2.2.0 was modified! *** from ac1121b (commit) to 7cae736 (commit) from

[airflow] 01/01: Manually fix constraints for Flake8 for python 3.6/7

2022-03-13 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a commit to tag constraints-2.2.0 in repository https://gitbox.apache.org/repos/asf/airflow.git commit 7cae73639009611f5de000f579da290b7fe63941 Author: Jarek Potiuk AuthorDate: Sun Mar 13 15:29:25 2022 +0100

[airflow] 01/01: Manually fix constraints for Flake8 for python 3.6/7

2022-03-13 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a commit to tag constraints-2.2.1 in repository https://gitbox.apache.org/repos/asf/airflow.git commit 411957b8188db3deeb9fd81f785bad858c319586 Author: Jarek Potiuk AuthorDate: Sun Mar 13 15:29:25 2022 +0100

[airflow] tag constraints-2.2.1 updated (84e6faa -> 411957b)

2022-03-13 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a change to tag constraints-2.2.1 in repository https://gitbox.apache.org/repos/asf/airflow.git. *** WARNING: tag constraints-2.2.1 was modified! *** from 84e6faa (tag) to 411957b (commit) from

[airflow] tag constraints-2.2.2 updated (9b206b8 -> 67c26e8)

2022-03-13 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a change to tag constraints-2.2.2 in repository https://gitbox.apache.org/repos/asf/airflow.git. *** WARNING: tag constraints-2.2.2 was modified! *** from 9b206b8 (commit) to 67c26e8 (commit) from

[airflow] branch constraints-2-2-2-fixed updated: Manually fix constraints for Flake8 for python 3.6/7

2022-03-13 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a commit to branch constraints-2-2-2-fixed in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/constraints-2-2-2-fixed by this push: new 67c26e8

[airflow] 01/01: Manually fix constraints for Flake8 for python 3.6/7

2022-03-13 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a commit to tag constraints-2.2.4 in repository https://gitbox.apache.org/repos/asf/airflow.git commit 201326c4817331149fd69d8870381eff348280a0 Author: Jarek Potiuk AuthorDate: Sun Mar 13 15:29:25 2022 +0100

[airflow] tag constraints-2.2.4 updated (3c76d72 -> 201326c)

2022-03-13 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a change to tag constraints-2.2.4 in repository https://gitbox.apache.org/repos/asf/airflow.git. *** WARNING: tag constraints-2.2.4 was modified! *** from 3c76d72 (tag) to 201326c (commit) from

[GitHub] [airflow] mik-laj commented on a change in pull request #22217: added docs about detailed network and constraints information

2022-03-13 Thread GitBox
mik-laj commented on a change in pull request #22217: URL: https://github.com/apache/airflow/pull/22217#discussion_r825457299 ## File path: airflow/providers/docker/operators/docker_swarm.py ## @@ -86,8 +86,19 @@ class DockerSwarmOperator(DockerOperator): :param mode:

[airflow] branch main updated (4543539 -> a840561)

2022-03-13 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git. from 4543539 Support Uploading Bigger Files to Google Drive (#22179) add a840561 AWS RDS integration fixes (#22125)

[GitHub] [airflow] potiuk merged pull request #22125: AWS RDS integration fixes

2022-03-13 Thread GitBox
potiuk merged pull request #22125: URL: https://github.com/apache/airflow/pull/22125 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[airflow] branch constraints-main updated: Update constraints after moto fixes

2022-03-13 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a commit to branch constraints-main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/constraints-main by this push: new 9dbf8bb Update

[GitHub] [airflow] potiuk commented on pull request #22125: AWS RDS integration fixes

2022-03-13 Thread GitBox
potiuk commented on pull request #22125: URL: https://github.com/apache/airflow/pull/22125#issuecomment-1066113634 Updated constraints manually. Merging. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

[airflow] 01/01: Also downgrade pycodestyle (dependency party!)

2022-03-13 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a commit to tag constraints-2.2.3 in repository https://gitbox.apache.org/repos/asf/airflow.git commit 38f73659dc90fa7a3c50dcd0c62b470a601188fb Author: Jarek Potiuk AuthorDate: Sun Mar 13 15:15:02 2022 +0100

  1   2   >