[GitHub] [airflow] priyadarshan1995 commented on issue #8448: Create S3ListPrefixesOperator that returns subfolders from an S3 bucket.

2021-10-10 Thread GitBox
priyadarshan1995 commented on issue #8448: URL: https://github.com/apache/airflow/issues/8448#issuecomment-939689994 is this being worked on ? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[airflow] branch constraints-main updated: Updating constraints. Build id:1327033784

2021-10-10 Thread github-bot
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a commit to branch constraints-main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/constraints-main by this push: new 8ebb0b2 Updating

[GitHub] [airflow] boring-cyborg[bot] commented on issue #18878: Allow change the Sensors default timeout

2021-10-10 Thread GitBox
boring-cyborg[bot] commented on issue #18878: URL: https://github.com/apache/airflow/issues/18878#issuecomment-939596754 Thanks for opening your first issue here! Be sure to follow the issue template! -- This is an automated message from the Apache Git Service. To respond to the

[GitHub] [airflow] mariotaddeucci opened a new issue #18878: Allow change the Sensors default timeout

2021-10-10 Thread GitBox
mariotaddeucci opened a new issue #18878: URL: https://github.com/apache/airflow/issues/18878 ### Description Add the configuration parameters to set the default `timeout` on `BaseSensorOperator`. ``` [core] sensor_default_timeout= ``` ### Use

[airflow] branch main updated (1d7cfdb -> 862ad04)

2021-10-10 Thread kamilbregula
This is an automated email from the ASF dual-hosted git repository. kamilbregula pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git. from 1d7cfdb Remove extra postgres dependency from AWS Provider (#18844) add 862ad04 Adds Bwtech and Inter

[GitHub] [airflow] mik-laj merged pull request #18876: Adds Bwtech and Inter Platform Inc. to the list of companies using Apache Airflow

2021-10-10 Thread GitBox
mik-laj merged pull request #18876: URL: https://github.com/apache/airflow/pull/18876 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] asaf400 edited a comment on issue #18874: DockerOperator xcom is broken

2021-10-10 Thread GitBox
asaf400 edited a comment on issue #18874: URL: https://github.com/apache/airflow/issues/18874#issuecomment-939575041 All the GitHub perm links I have published here are LATEST main/master branches of each repository, therefore I actually think that I have done my due diligence enough to

[GitHub] [airflow] asaf400 edited a comment on issue #18874: DockerOperator xcom is broken

2021-10-10 Thread GitBox
asaf400 edited a comment on issue #18874: URL: https://github.com/apache/airflow/issues/18874#issuecomment-939575041 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

[GitHub] [airflow] asaf400 edited a comment on issue #18874: DockerOperator xcom is broken

2021-10-10 Thread GitBox
asaf400 edited a comment on issue #18874: URL: https://github.com/apache/airflow/issues/18874#issuecomment-939575041 All the GitHub perm links I have published here are LATEST main/master branches of each repository, therefore I actually think that I have done my due diligence enough to

[GitHub] [airflow] asaf400 edited a comment on issue #18874: DockerOperator xcom is broken

2021-10-10 Thread GitBox
asaf400 edited a comment on issue #18874: URL: https://github.com/apache/airflow/issues/18874#issuecomment-939575041 All the GitHub perm links I have published here are LATEST main/master branches of each repository, therefore I actually think that I have done my due diligence enough to

[GitHub] [airflow] asaf400 edited a comment on issue #18874: DockerOperator xcom is broken

2021-10-10 Thread GitBox
asaf400 edited a comment on issue #18874: URL: https://github.com/apache/airflow/issues/18874#issuecomment-939575041 All the GitHub perm links I have published here are LATEST main/master branches of each repository, therefore I actually think that I have done my due diligence enough to

[GitHub] [airflow] asaf400 edited a comment on issue #18874: DockerOperator xcom is broken

2021-10-10 Thread GitBox
asaf400 edited a comment on issue #18874: URL: https://github.com/apache/airflow/issues/18874#issuecomment-939575041 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

[GitHub] [airflow] asaf400 commented on issue #18874: DockerOperator xcom is broken

2021-10-10 Thread GitBox
asaf400 commented on issue #18874: URL: https://github.com/apache/airflow/issues/18874#issuecomment-939575041 All the GitHub perm links I have published here are LATEST main/master branches of each repository, therefore I actually think that I have done my due diligence enough to say

[GitHub] [airflow] wolvery commented on a change in pull request #18876: Adds Bwtech and Inter Platform Inc. to the list of companies using Apache Airflow

2021-10-10 Thread GitBox
wolvery commented on a change in pull request #18876: URL: https://github.com/apache/airflow/pull/18876#discussion_r725715911 ## File path: INTHEWILD.md ## @@ -461,3 +461,6 @@ Currently, **officially** using Airflow: 1. [Zerodha](https://zerodha.com/)

[GitHub] [airflow] wolvery commented on pull request #18877: Azure: New sftp to wasb operator

2021-10-10 Thread GitBox
wolvery commented on pull request #18877: URL: https://github.com/apache/airflow/pull/18877#issuecomment-939568964 Hi! I had approval from @ephraimbuddy in this #14254 which contains the same code. -- This is an automated message from the Apache Git Service. To respond to the

[GitHub] [airflow] wolvery commented on issue #9683: Transfer to upload files from SFTP to Azure Blob Storage

2021-10-10 Thread GitBox
wolvery commented on issue #9683: URL: https://github.com/apache/airflow/issues/9683#issuecomment-939568699 Hi! I have a new MR to be reviewed about this issue: #18877 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [airflow] wolvery opened a new pull request #18877: Azure: New sftp to wasb operator

2021-10-10 Thread GitBox
wolvery opened a new pull request #18877: URL: https://github.com/apache/airflow/pull/18877 --- **^ Add meaningful description above** Read the **[Pull Request Guidelines](https://github.com/apache/airflow/blob/main/CONTRIBUTING.rst#pull-request-guidelines)** for more

[GitHub] [airflow] mik-laj commented on a change in pull request #18876: Adds Bwtech and Inter Platform Inc. to the list of companies using Apache Airflow

2021-10-10 Thread GitBox
mik-laj commented on a change in pull request #18876: URL: https://github.com/apache/airflow/pull/18876#discussion_r725712853 ## File path: INTHEWILD.md ## @@ -461,3 +461,6 @@ Currently, **officially** using Airflow: 1. [Zerodha](https://zerodha.com/)

[GitHub] [airflow] wolvery opened a new pull request #18876: Adds Bwtech and Inter Platform Inc. to the list of companies using Apache Airflow

2021-10-10 Thread GitBox
wolvery opened a new pull request #18876: URL: https://github.com/apache/airflow/pull/18876 Adds Bwtech and Inter Platform Inc. to the list of companies using Apache Airflow -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

[airflow] branch constraints-main updated: Updating constraints. Build id:1326633604

2021-10-10 Thread github-bot
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a commit to branch constraints-main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/constraints-main by this push: new 38f1720 Updating

[GitHub] [airflow] mik-laj commented on a change in pull request #18675: New Tree View

2021-10-10 Thread GitBox
mik-laj commented on a change in pull request #18675: URL: https://github.com/apache/airflow/pull/18675#discussion_r725706649 ## File path: airflow/www/package.json ## @@ -56,19 +60,29 @@ "webpack-manifest-plugin": "^2.2.0" }, "dependencies": { +

[GitHub] [airflow] mik-laj commented on a change in pull request #18675: New Tree View

2021-10-10 Thread GitBox
mik-laj commented on a change in pull request #18675: URL: https://github.com/apache/airflow/pull/18675#discussion_r725705965 ## File path: airflow/www/static/js/tree/useTreeData.js ## @@ -0,0 +1,79 @@ +/*! + * Licensed to the Apache Software Foundation (ASF) under one + * or

[GitHub] [airflow] mik-laj commented on a change in pull request #18675: New Tree View

2021-10-10 Thread GitBox
mik-laj commented on a change in pull request #18675: URL: https://github.com/apache/airflow/pull/18675#discussion_r725705471 ## File path: airflow/www/static/js/tree/InstanceTooltip.jsx ## @@ -0,0 +1,155 @@ +/*! + * Licensed to the Apache Software Foundation (ASF) under one +

[GitHub] [airflow] mik-laj commented on a change in pull request #18675: New Tree View

2021-10-10 Thread GitBox
mik-laj commented on a change in pull request #18675: URL: https://github.com/apache/airflow/pull/18675#discussion_r725705167 ## File path: airflow/www/static/js/tree/DagRunBar.jsx ## @@ -0,0 +1,84 @@ +/*! + * Licensed to the Apache Software Foundation (ASF) under one + * or

[GitHub] [airflow] potiuk commented on pull request #18800: Make the salesforce connection initiation more robust

2021-10-10 Thread GitBox
potiuk commented on pull request #18800: URL: https://github.com/apache/airflow/pull/18800#issuecomment-939556368 Closed/reopened to rebuild. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [airflow] potiuk closed pull request #18800: Make the salesforce connection initiation more robust

2021-10-10 Thread GitBox
potiuk closed pull request #18800: URL: https://github.com/apache/airflow/pull/18800 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] potiuk commented on issue #18549: CloudWatch CreateLogGroup error on already existing LogGroup

2021-10-10 Thread GitBox
potiuk commented on issue #18549: URL: https://github.com/apache/airflow/issues/18549#issuecomment-939556165 Hard to say. I am not expert on cloud-watch - but maybe others can help :) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [airflow] boring-cyborg[bot] commented on pull request #18875: Add explicit session parameter in PoolSlotsAvailableDep

2021-10-10 Thread GitBox
boring-cyborg[bot] commented on pull request #18875: URL: https://github.com/apache/airflow/pull/18875#issuecomment-939555860 Congratulations on your first Pull Request and welcome to the Apache Airflow community! If you have any issues or are unsure about any anything please check our

[GitHub] [airflow] avkirilishin opened a new pull request #18875: Add explicit session parameter in PoolSlotsAvailableDep

2021-10-10 Thread GitBox
avkirilishin opened a new pull request #18875: URL: https://github.com/apache/airflow/pull/18875 An open_slots function accepts a session parameter, and it should not commit the transaction itself. The absence of a parameter causes an implicit commit and may lead to undesirable

[GitHub] [airflow] mik-laj commented on a change in pull request #18675: New Tree View

2021-10-10 Thread GitBox
mik-laj commented on a change in pull request #18675: URL: https://github.com/apache/airflow/pull/18675#discussion_r725699454 ## File path: airflow/www/package.json ## @@ -56,19 +60,29 @@ "webpack-manifest-plugin": "^2.2.0" }, "dependencies": { +

[GitHub] [airflow] potiuk commented on pull request #16110: Added windows extensions

2021-10-10 Thread GitBox
potiuk commented on pull request #16110: URL: https://github.com/apache/airflow/pull/16110#issuecomment-939552459 Looks like -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [airflow] potiuk commented on pull request #18872: Remove the docker timeout workaround

2021-10-10 Thread GitBox
potiuk commented on pull request #18872: URL: https://github.com/apache/airflow/pull/18872#issuecomment-939552015 Close/reopen to rebuild -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [airflow] potiuk closed pull request #18872: Remove the docker timeout workaround

2021-10-10 Thread GitBox
potiuk closed pull request #18872: URL: https://github.com/apache/airflow/pull/18872 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[airflow] branch main updated: Remove extra postgres dependency from AWS Provider (#18844)

2021-10-10 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new 1d7cfdb Remove extra postgres dependency from AWS

[GitHub] [airflow] potiuk merged pull request #18844: Remove extra postgres dependency from AWS Provider

2021-10-10 Thread GitBox
potiuk merged pull request #18844: URL: https://github.com/apache/airflow/pull/18844 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] ephraimbuddy commented on issue #18843: SerializedDagNotFound: DAG not found in serialized_dag table

2021-10-10 Thread GitBox
ephraimbuddy commented on issue #18843: URL: https://github.com/apache/airflow/issues/18843#issuecomment-939551033 cc @kaxil -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [airflow] ephraimbuddy commented on a change in pull request #18675: New Tree View

2021-10-10 Thread GitBox
ephraimbuddy commented on a change in pull request #18675: URL: https://github.com/apache/airflow/pull/18675#discussion_r725692558 ## File path: airflow/www/views.py ## @@ -219,6 +219,82 @@ def get_date_time_num_runs_dag_runs_form_data(www_request, session, dag): }

[airflow] branch new-tree-view updated: apply reviews from code review

2021-10-10 Thread ephraimanierobi
This is an automated email from the ASF dual-hosted git repository. ephraimanierobi pushed a commit to branch new-tree-view in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/new-tree-view by this push: new 23af0d0 apply reviews

[GitHub] [airflow] potiuk commented on pull request #18745: Don't install SQLAlchemy/Pendulum adapters for other DBs

2021-10-10 Thread GitBox
potiuk commented on pull request #18745: URL: https://github.com/apache/airflow/pull/18745#issuecomment-939533671 > I could not reproduce it with Ash's image but the good news I have it nicely reproducible on our Runner EC2 instance crossed_fingers `export

[GitHub] [airflow] potiuk commented on pull request #18745: Don't install SQLAlchemy/Pendulum adapters for other DBs

2021-10-10 Thread GitBox
potiuk commented on pull request #18745: URL: https://github.com/apache/airflow/pull/18745#issuecomment-939533209 I could not reproduce it with Ash's image but the good news I have it nicely reproducible on our Runner EC2 instance :crossed_fingers: -- This is an automated message

[GitHub] [airflow] potiuk commented on pull request #18745: Don't install SQLAlchemy/Pendulum adapters for other DBs

2021-10-10 Thread GitBox
potiuk commented on pull request #18745: URL: https://github.com/apache/airflow/pull/18745#issuecomment-939525292 Kernel on our runner's instance's is newer (and we saw it happening there): `Linux ip-172-31-31-24 5.11.0-1019-aws #20~20.04.1-Ubuntu SMP Tue Sep 21 10:40:39 UTC 2021 x86_64

[airflow] branch main updated (232f7d1 -> b9fff8c)

2021-10-10 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git. from 232f7d1 fix get_connections deprecation warn in hivemetastore hook (#18854) add b9fff8c Add MSSQL variables

[GitHub] [airflow] potiuk merged pull request #18873: Add MSSQL variables to dc_ci script

2021-10-10 Thread GitBox
potiuk merged pull request #18873: URL: https://github.com/apache/airflow/pull/18873 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] potiuk edited a comment on issue #18874: DockerOperator xcom is broken

2021-10-10 Thread GitBox
potiuk edited a comment on issue #18874: URL: https://github.com/apache/airflow/issues/18874#issuecomment-939523442 This part of docker provider had gone through a number of changes and improvements and a number of bug have been fixed. What you are observing is very likley already fixed

[GitHub] [airflow] potiuk edited a comment on issue #18874: DockerOperator xcom is broken

2021-10-10 Thread GitBox
potiuk edited a comment on issue #18874: URL: https://github.com/apache/airflow/issues/18874#issuecomment-939523442 This part of docker provider had gone through a number of changes and improvements and a number of bug have been fixed. What you are observing is very likley already fixed

[GitHub] [airflow] potiuk commented on issue #18874: DockerOperator xcom is broken

2021-10-10 Thread GitBox
potiuk commented on issue #18874: URL: https://github.com/apache/airflow/issues/18874#issuecomment-939523442 This part of docker provider had gone through a number of changes and improvements and a number of bug have been fixed. What you are observing is very likley already fixed in

[GitHub] [airflow] potiuk closed issue #18874: DockerOperator xcom is broken

2021-10-10 Thread GitBox
potiuk closed issue #18874: URL: https://github.com/apache/airflow/issues/18874 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] github-actions[bot] commented on pull request #18844: Remove extra postgres dependency from AWS Provider

2021-10-10 Thread GitBox
github-actions[bot] commented on pull request #18844: URL: https://github.com/apache/airflow/pull/18844#issuecomment-939521906 The PR is likely OK to be merged with just subset of tests for default Python and Database versions without running the full matrix of tests, because it does not

[GitHub] [airflow] asaf400 commented on issue #18874: DockerOperator xcom is broken

2021-10-10 Thread GitBox
asaf400 commented on issue #18874: URL: https://github.com/apache/airflow/issues/18874#issuecomment-939509619 ![image](https://user-images.githubusercontent.com/14169006/136704231-b77eb571-22cb-4ab1-b318-c07cba240e2c.png) Documentation from docker-py -- This is an automated message

[GitHub] [airflow] boring-cyborg[bot] commented on issue #18874: DockerOperator xcom is broken

2021-10-10 Thread GitBox
boring-cyborg[bot] commented on issue #18874: URL: https://github.com/apache/airflow/issues/18874#issuecomment-939509376 Thanks for opening your first issue here! Be sure to follow the issue template! -- This is an automated message from the Apache Git Service. To respond to the

[GitHub] [airflow] asaf400 opened a new issue #18874: DockerOperator xcom is broken

2021-10-10 Thread GitBox
asaf400 opened a new issue #18874: URL: https://github.com/apache/airflow/issues/18874 ### Apache Airflow version 2.1.3 ### Operating System ubuntu 20.04 ### Versions of Apache Airflow Providers apache-airflow-providers-amazon==1.3.0

[airflow] branch new-tree-view created (now cd82b5b)

2021-10-10 Thread ephraimanierobi
This is an automated email from the ASF dual-hosted git repository. ephraimanierobi pushed a change to branch new-tree-view in repository https://gitbox.apache.org/repos/asf/airflow.git. at cd82b5b update hover/group colors and add vertical tick marks No new revisions were added by this

[GitHub] [airflow] guotongfei commented on a change in pull request #18755: MySQLToS3Operator add support for parquet format

2021-10-10 Thread GitBox
guotongfei commented on a change in pull request #18755: URL: https://github.com/apache/airflow/pull/18755#discussion_r725652119 ## File path: airflow/providers/amazon/aws/transfers/mysql_to_s3.py ## @@ -92,15 +117,40 @@ def __init__( self.aws_conn_id = aws_conn_id

[GitHub] [airflow] potiuk commented on pull request #18745: Don't install SQLAlchemy/Pendulum adapters for other DBs

2021-10-10 Thread GitBox
potiuk commented on pull request #18745: URL: https://github.com/apache/airflow/pull/18745#issuecomment-939496777 > @potiuk Pushing up `ashb/airflow-test:py3-8-with-libcpperror` now. Pushed now. > > It seems to _fairly_ relibably happen for the first time I run this command in the

[GitHub] [airflow] github-actions[bot] commented on pull request #18873: Add MSSQL variables to dc_ci script

2021-10-10 Thread GitBox
github-actions[bot] commented on pull request #18873: URL: https://github.com/apache/airflow/pull/18873#issuecomment-939494786 The PR is likely ready to be merged. No tests are needed as no important environment files, nor python files were modified by it. However, committers might decide

[GitHub] [airflow] potiuk opened a new pull request #18873: Add MSSQL variables to dc_ci script

2021-10-10 Thread GitBox
potiuk opened a new pull request #18873: URL: https://github.com/apache/airflow/pull/18873 The dc_ci script is generated in `.build` folder so that you can easily run docker compose command with multiple combined docker-compose files and reproduce manually what breeze does. Useful

[GitHub] [airflow] potiuk closed pull request #18863: Handle occasional segfaults despite tests succeding

2021-10-10 Thread GitBox
potiuk closed pull request #18863: URL: https://github.com/apache/airflow/pull/18863 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] potiuk edited a comment on pull request #18863: Handle occasional segfaults despite tests succeding

2021-10-10 Thread GitBox
potiuk edited a comment on pull request #18863: URL: https://github.com/apache/airflow/pull/18863#issuecomment-939490907 Another good example of segfault after all tests succeeded https://github.com/potiuk/airflow/runs/3851528364?check_suite_focus=true#step:6:8631 -- This is an

[GitHub] [airflow] potiuk commented on pull request #18863: Handle occasional segfaults despite tests succeding

2021-10-10 Thread GitBox
potiuk commented on pull request #18863: URL: https://github.com/apache/airflow/pull/18863#issuecomment-939490907 Another good example of segfault after all tests succeeded. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

[GitHub] [airflow] potiuk commented on a change in pull request #17974: Implement before stm and after stm

2021-10-10 Thread GitBox
potiuk commented on a change in pull request #17974: URL: https://github.com/apache/airflow/pull/17974#discussion_r725644559 ## File path: airflow/providers/mysql/hooks/mysql.py ## @@ -282,3 +282,25 @@ def bulk_load_custom( cursor.close() conn.commit() +

[airflow] branch main updated: fix get_connections deprecation warn in hivemetastore hook (#18854)

2021-10-10 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new 232f7d1 fix get_connections deprecation warn in

[GitHub] [airflow] potiuk merged pull request #18854: fix get_connections deprecation warn in hivemetastore hook

2021-10-10 Thread GitBox
potiuk merged pull request #18854: URL: https://github.com/apache/airflow/pull/18854 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] bbovenzi commented on issue #16986: Retrying a task from inside task instance view

2021-10-10 Thread GitBox
bbovenzi commented on issue #16986: URL: https://github.com/apache/airflow/issues/16986#issuecomment-939484370 @zkan go for it! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [airflow] zkan commented on issue #16986: Retrying a task from inside task instance view

2021-10-10 Thread GitBox
zkan commented on issue #16986: URL: https://github.com/apache/airflow/issues/16986#issuecomment-939484010 @potiuk May I take this issue, please? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[airflow] branch main updated: Strips suffixes from docker version (#18871)

2021-10-10 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new 34e09cc Strips suffixes from docker version

[GitHub] [airflow] potiuk merged pull request #18871: Strips post-fixes from docker version

2021-10-10 Thread GitBox
potiuk merged pull request #18871: URL: https://github.com/apache/airflow/pull/18871 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] turbaszek commented on a change in pull request #18871: Strips post-fixes from docker version

2021-10-10 Thread GitBox
turbaszek commented on a change in pull request #18871: URL: https://github.com/apache/airflow/pull/18871#discussion_r725634763 ## File path: scripts/ci/libraries/_initialization.sh ## @@ -907,7 +907,14 @@ function initialization::ver() { function

[GitHub] [airflow] potiuk edited a comment on pull request #18863: Handle occasional segfaults despite tests succeding

2021-10-10 Thread GitBox
potiuk edited a comment on pull request #18863: URL: https://github.com/apache/airflow/pull/18863#issuecomment-939474188 And here is an example failure, where this would help us to avoid unnecessary "red" mark (hopefully - I assume the junit.xml file will be written before the segfault

[GitHub] [airflow] potiuk commented on pull request #18863: Handle occasional segfaults despite tests succeding

2021-10-10 Thread GitBox
potiuk commented on pull request #18863: URL: https://github.com/apache/airflow/pull/18863#issuecomment-939474188 And here is an example failure, where this would help us to avoid unnecessary "red" mark (hopefully - I assume the junit.xml file will be written before the segfault.

[GitHub] [airflow] potiuk commented on pull request #18863: Handle occasional segfaults despite tests succeding

2021-10-10 Thread GitBox
potiuk commented on pull request #18863: URL: https://github.com/apache/airflow/pull/18863#issuecomment-939473641 Tested in my fork: https://github.com/potiuk/airflow/runs/3850838988?check_suite_focus=true This is how it will look like when 139 error produces no failures:

[GitHub] [airflow] boring-cyborg[bot] commented on pull request #18872: [WIP] Remove the docker timeout workaround

2021-10-10 Thread GitBox
boring-cyborg[bot] commented on pull request #18872: URL: https://github.com/apache/airflow/pull/18872#issuecomment-939473456 Congratulations on your first Pull Request and welcome to the Apache Airflow community! If you have any issues or are unsure about any anything please check our

[GitHub] [airflow] RyanSiu1995 opened a new pull request #18872: [WIP] Remove the docker timeout workaround

2021-10-10 Thread GitBox
RyanSiu1995 opened a new pull request #18872: URL: https://github.com/apache/airflow/pull/18872 closes: #18867 Remove the workaround because of the upgrade in the docker dependencies --- **^ Add meaningful description above** Read the **[Pull Request

[GitHub] [airflow] potiuk commented on pull request #18871: Strips post-fixes from docker version

2021-10-10 Thread GitBox
potiuk commented on pull request #18871: URL: https://github.com/apache/airflow/pull/18871#issuecomment-939472667 Example failure here: https://github.com/apache/airflow/runs/3851284100?check_suite_focus=true#step:3:13 -- This is an automated message from the Apache Git Service. To

[GitHub] [airflow] potiuk opened a new pull request #18871: Strips post-fixes from docker version

2021-10-10 Thread GitBox
potiuk opened a new pull request #18871: URL: https://github.com/apache/airflow/pull/18871 This version will strip any + alpha postfixes from docker version. Seems that CodeQL uses azure-specific docker version and the version is postfixed with `+azure`. This change will strip postfix

[airflow] branch main updated: Check min docker version (#18869)

2021-10-10 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new 36e39f6 Check min docker version (#18869) 36e39f6

[GitHub] [airflow] potiuk merged pull request #18869: Check min docker version

2021-10-10 Thread GitBox
potiuk merged pull request #18869: URL: https://github.com/apache/airflow/pull/18869 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] github-actions[bot] commented on pull request #18869: Check min docker version

2021-10-10 Thread GitBox
github-actions[bot] commented on pull request #18869: URL: https://github.com/apache/airflow/pull/18869#issuecomment-939465436 The PR most likely needs to run full matrix of tests because it modifies parts of the core of Airflow. However, committers might decide to merge it quickly and

[GitHub] [airflow] potiuk edited a comment on issue #18870: TaskFlow usage leads to parsing warning: Dependency already registered for DAG

2021-10-10 Thread GitBox
potiuk edited a comment on issue #18870: URL: https://github.com/apache/airflow/issues/18870#issuecomment-939464120 You should use `@dag` decorator when you are using taskflow API not `with DAG`.

[GitHub] [airflow] potiuk edited a comment on issue #18870: TaskFlow usage leads to parsing warning: Dependency already registered for DAG

2021-10-10 Thread GitBox
potiuk edited a comment on issue #18870: URL: https://github.com/apache/airflow/issues/18870#issuecomment-939464120 You should use `@dag` decorator when you are usign taskflow API not `with DAG`.

[GitHub] [airflow] potiuk closed issue #18870: TaskFlow usage leads to parsing warning: Dependency already registered for DAG

2021-10-10 Thread GitBox
potiuk closed issue #18870: URL: https://github.com/apache/airflow/issues/18870 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] potiuk commented on issue #18870: TaskFlow usage leads to parsing warning: Dependency already registered for DAG

2021-10-10 Thread GitBox
potiuk commented on issue #18870: URL: https://github.com/apache/airflow/issues/18870#issuecomment-939464120 You should use `@dag` decorator when you are usign taskflow API. https://airflow.apache.org/docs/apache-airflow/stable/tutorial_taskflow_api.html#tutorial-on-the-taskflow-api

[GitHub] [airflow] potiuk commented on issue #18867: Fix DockerSwarmOperator timeout

2021-10-10 Thread GitBox
potiuk commented on issue #18867: URL: https://github.com/apache/airflow/issues/18867#issuecomment-939463336 Assigned it to you @RyanSiu1995! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [airflow] mrbazzan commented on issue #12282: Rewrite Breeze in Python

2021-10-10 Thread GitBox
mrbazzan commented on issue #12282: URL: https://github.com/apache/airflow/issues/12282#issuecomment-939462066 I am interested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [airflow] KulykDmytro opened a new issue #18870: TaskFlow usage leads to parsing warning: Dependency already registered for DAG

2021-10-10 Thread GitBox
KulykDmytro opened a new issue #18870: URL: https://github.com/apache/airflow/issues/18870 ### Apache Airflow version 2.1.4 (latest released) ### Operating System Linux 5.4.149-73.259.amzn2.x86_64 ### Versions of Apache Airflow Providers _No response_

[GitHub] [airflow] RyanSiu1995 commented on issue #18867: Fix DockerSwarmOperator timeout

2021-10-10 Thread GitBox
RyanSiu1995 commented on issue #18867: URL: https://github.com/apache/airflow/issues/18867#issuecomment-939462089 I will pick this up. Will open the PR shortly. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[GitHub] [airflow] potiuk commented on pull request #18869: Check min docker version

2021-10-10 Thread GitBox
potiuk commented on pull request #18869: URL: https://github.com/apache/airflow/pull/18869#issuecomment-939449791 cc: @zachliu -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [airflow] potiuk opened a new pull request #18869: Check min docker version

2021-10-10 Thread GitBox
potiuk opened a new pull request #18869: URL: https://github.com/apache/airflow/pull/18869 We have recently introduced a few features (--pull flag for example) in our docker commands, that require newer version of Docker (the `--pull` flag was introduced in 20.10.0). This PR adds

[airflow] branch constraints-main updated: Updating constraints. Build id:1325356373

2021-10-10 Thread github-bot
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a commit to branch constraints-main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/constraints-main by this push: new e5cd858 Updating

[GitHub] [airflow] potiuk commented on a change in pull request #18784: Make a separate hook for interacting with the Pagerduty Events API

2021-10-10 Thread GitBox
potiuk commented on a change in pull request #18784: URL: https://github.com/apache/airflow/pull/18784#discussion_r725610984 ## File path: airflow/providers/pagerduty/hooks/pagerduty.py ## @@ -129,10 +147,114 @@ def create_event( :return: PagerDuty Events API v2

[GitHub] [airflow] potiuk opened a new pull request #18868: Add back information about current context to the docs

2021-10-10 Thread GitBox
potiuk opened a new pull request #18868: URL: https://github.com/apache/airflow/pull/18868 There were many questions recently along the line of "How do I access context from TaskFlow task". Surprisingly, the paragraph about accessing current context was removed from the "Concepts"

[GitHub] [airflow] eladkal commented on issue #10341: Newly-created DAG is loaded in DB but existing DagBag instances are unable to get the DAG

2021-10-10 Thread GitBox
eladkal commented on issue #10341: URL: https://github.com/apache/airflow/issues/10341#issuecomment-939428235 This issue is reported against old version of Airflow (which is end of life). If the issue is still present in latest airflow version please let us know. -- This is an

[GitHub] [airflow] eladkal closed issue #10341: Newly-created DAG is loaded in DB but existing DagBag instances are unable to get the DAG

2021-10-10 Thread GitBox
eladkal closed issue #10341: URL: https://github.com/apache/airflow/issues/10341 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] tomerav0 edited a comment on issue #18792: Externally triggered DAG's fails when there is a queue spike

2021-10-10 Thread GitBox
tomerav0 edited a comment on issue #18792: URL: https://github.com/apache/airflow/issues/18792#issuecomment-939427819 > Look into the scheduler logs for any logs before the first error above There is no errors. The task is adopted in PENDING state and after 2 seconds got the fail

[airflow] branch main updated: Attempt to fix flaky timeout test (#18862)

2021-10-10 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new 8cb3518 Attempt to fix flaky timeout test

[GitHub] [airflow] potiuk merged pull request #18862: Attempt to fix flaky timeout test

2021-10-10 Thread GitBox
potiuk merged pull request #18862: URL: https://github.com/apache/airflow/pull/18862 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] tomerav0 commented on issue #18792: Externally triggered DAG's fails when there is a queue spike

2021-10-10 Thread GitBox
tomerav0 commented on issue #18792: URL: https://github.com/apache/airflow/issues/18792#issuecomment-939427819 > Look into the scheduler logs for any logs before the first error above There is no errors. The task is adopted in PENDING state and after 2 seconds got the fail error:

[GitHub] [airflow] eladkal commented on issue #13747: Airflow task is marked as zombie , when the backend process on remote server is still running.

2021-10-10 Thread GitBox
eladkal commented on issue #13747: URL: https://github.com/apache/airflow/issues/13747#issuecomment-939427595 This issue is reported against old version of airflow which is end of life. If the issue still happens in latest airflow version please let us know & provide updated details.

[GitHub] [airflow] eladkal closed issue #13747: Airflow task is marked as zombie , when the backend process on remote server is still running.

2021-10-10 Thread GitBox
eladkal closed issue #13747: URL: https://github.com/apache/airflow/issues/13747 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] eladkal commented on issue #11290: Logout issues with Gihub Enterprise auth enabled

2021-10-10 Thread GitBox
eladkal commented on issue #11290: URL: https://github.com/apache/airflow/issues/11290#issuecomment-939427214 @jykae would you be interested in updating the documentation? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

[GitHub] [airflow] eladkal opened a new issue #18867: Fix DockerSwarmOperator timeout

2021-10-10 Thread GitBox
eladkal opened a new issue #18867: URL: https://github.com/apache/airflow/issues/18867 ### Body See discussion in https://github.com/apache/airflow/discussions/18270 `docker-py` released version 5.0.3 https://github.com/docker/docker-py/releases/tag/5.0.3 which fixed

  1   2   >