[GitHub] [airflow] dstandish commented on a change in pull request #18447: add RedshiftStatementHook, RedshiftOperator

2021-09-27 Thread GitBox
dstandish commented on a change in pull request #18447: URL: https://github.com/apache/airflow/pull/18447#discussion_r717216128 ## File path: tests/providers/amazon/aws/hooks/test_redshift_statement.py ## @@ -0,0 +1,72 @@ +# +# Licensed to the Apache Software Foundation (ASF)

[GitHub] [airflow] dstandish commented on a change in pull request #18447: add RedshiftStatementHook, RedshiftOperator

2021-09-27 Thread GitBox
dstandish commented on a change in pull request #18447: URL: https://github.com/apache/airflow/pull/18447#discussion_r717131359 ## File path: airflow/providers/amazon/aws/hooks/redshift_statement.py ## @@ -0,0 +1,131 @@ +# +# Licensed to the Apache Software Foundation (ASF)

[GitHub] [airflow] mik-laj commented on a change in pull request #18563: Test kubernetes refresh config

2021-09-27 Thread GitBox
mik-laj commented on a change in pull request #18563: URL: https://github.com/apache/airflow/pull/18563#discussion_r717209660 ## File path: tests/kubernetes/test_refresh_config.py ## @@ -35,3 +43,64 @@ def

[GitHub] [airflow] josh-fell opened a new pull request #18565: Updating the Elasticsearch example DAG to use the TaskFlow API

2021-09-27 Thread GitBox
josh-fell opened a new pull request #18565: URL: https://github.com/apache/airflow/pull/18565 Related: #9415 This was missed from #18278 which updated miscellaneous example DAGs in providers to use the TaskFlow API. This PR updates the example DAG for Elasticsearch in the same

[GitHub] [airflow] josh-fell opened a new pull request #18564: Adding `task_group` parameter to the `BaseOperator` docstring

2021-09-27 Thread GitBox
josh-fell opened a new pull request #18564: URL: https://github.com/apache/airflow/pull/18564 In the `BaseOperator` docstring the `task_group` parameter was missing and therefore missing from the documentation. --- **^ Add meaningful description above** Read the **[Pull

[GitHub] [airflow] subkanthi opened a new pull request #18563: Test kubernetes refresh config

2021-09-27 Thread GitBox
subkanthi opened a new pull request #18563: URL: https://github.com/apache/airflow/pull/18563 --- **^ Add meaningful description above** Read the **[Pull Request Guidelines](https://github.com/apache/airflow/blob/main/CONTRIBUTING.rst#pull-request-guidelines)** for more

[GitHub] [airflow] r-richmond commented on issue #14396: Make context less nebulous

2021-09-27 Thread GitBox
r-richmond commented on issue #14396: URL: https://github.com/apache/airflow/issues/14396#issuecomment-928642301 @kaxil Noticed this keeps getting pushed. Can you provide any additional context? -- This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [airflow] josh-fell opened a new pull request #18562: Updating core example DAGs to use TaskFlow API where applicable

2021-09-27 Thread GitBox
josh-fell opened a new pull request #18562: URL: https://github.com/apache/airflow/pull/18562 Related: #9415 This PR aims to replace the use of PythonOperator tasks for the TaskFlow API in several core example DAGs. Additionally, there are instances of replacing

[GitHub] [airflow] ShakaibKhan commented on issue #17487: Make gantt view to show also retries

2021-09-27 Thread GitBox
ShakaibKhan commented on issue #17487: URL: https://github.com/apache/airflow/issues/17487#issuecomment-928564345 I would like to try implementing this -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[GitHub] [airflow] boring-cyborg[bot] commented on pull request #18561: Update s3_list.py

2021-09-27 Thread GitBox
boring-cyborg[bot] commented on pull request #18561: URL: https://github.com/apache/airflow/pull/18561#issuecomment-928522307 Congratulations on your first Pull Request and welcome to the Apache Airflow community! If you have any issues or are unsure about any anything please check our

[GitHub] [airflow] Xilorole opened a new pull request #18561: Update s3_list.py

2021-09-27 Thread GitBox
Xilorole opened a new pull request #18561: URL: https://github.com/apache/airflow/pull/18561 removed inappropriate character `{` from the error message -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[GitHub] [airflow] GaoJiaChengPaul edited a comment on issue #16881: Re-deploy scheduler tasks failing with SIGTERM on K8s executor

2021-09-27 Thread GitBox
GaoJiaChengPaul edited a comment on issue #16881: URL: https://github.com/apache/airflow/issues/16881#issuecomment-928504787 Hi All, We are having the same problem as below discussion. In our case we are running 2 schedulers in two different clusters with Kubernetes Executor.

[GitHub] [airflow] GaoJiaChengPaul commented on issue #16881: Re-deploy scheduler tasks failing with SIGTERM on K8s executor

2021-09-27 Thread GitBox
GaoJiaChengPaul commented on issue #16881: URL: https://github.com/apache/airflow/issues/16881#issuecomment-928504787 Hi All, We are having the same problem as below discussion. In our case we are running 2 schedulers in two different clusters with Kubernetes Executor. #18455

[GitHub] [airflow] Brooke-white commented on a change in pull request #18447: add RedshiftStatementHook, RedshiftOperator

2021-09-27 Thread GitBox
Brooke-white commented on a change in pull request #18447: URL: https://github.com/apache/airflow/pull/18447#discussion_r717126873 ## File path: airflow/providers/amazon/aws/hooks/redshift_statement.py ## @@ -0,0 +1,159 @@ +# +# Licensed to the Apache Software Foundation (ASF)

[GitHub] [airflow] github-actions[bot] closed pull request #16647: Move FABs base Security Manager into Airflow.

2021-09-27 Thread GitBox
github-actions[bot] closed pull request #16647: URL: https://github.com/apache/airflow/pull/16647 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] github-actions[bot] closed pull request #16498: gitpodify Apache Airflow - online development workspace

2021-09-27 Thread GitBox
github-actions[bot] closed pull request #16498: URL: https://github.com/apache/airflow/pull/16498 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] github-actions[bot] closed pull request #17354: Add Docker Sensor

2021-09-27 Thread GitBox
github-actions[bot] closed pull request #17354: URL: https://github.com/apache/airflow/pull/17354 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] github-actions[bot] commented on pull request #16795: GCP Dataflow - Fixed getting job status by job id

2021-09-27 Thread GitBox
github-actions[bot] commented on pull request #16795: URL: https://github.com/apache/airflow/pull/16795#issuecomment-928481553 This pull request has been automatically marked as stale because it has not had recent activity. It will be closed in 5 days if no further activity occurs. Thank

[GitHub] [airflow] t4n1o edited a comment on issue #18541: Error when running dag & something to do with parsing the start date

2021-09-27 Thread GitBox
t4n1o edited a comment on issue #18541: URL: https://github.com/apache/airflow/issues/18541#issuecomment-928440208 Would it help if I upgraded airflow to a newer version (2.14)? The dag I'm running that caused this has `start_date` set to: ``` with DAG( 'Archives

[GitHub] [airflow] t4n1o edited a comment on issue #18541: Error when running dag & something to do with parsing the start date

2021-09-27 Thread GitBox
t4n1o edited a comment on issue #18541: URL: https://github.com/apache/airflow/issues/18541#issuecomment-928440208 Would it help if I upgraded airflow to a newer version (2.14)? The dag I'm running that caused this has `start_date` set to: ``` with DAG( 'Archives

[GitHub] [airflow] t4n1o edited a comment on issue #18541: Error when running dag & something to do with parsing the start date

2021-09-27 Thread GitBox
t4n1o edited a comment on issue #18541: URL: https://github.com/apache/airflow/issues/18541#issuecomment-928440208 Would it help if I upgraded airflow to a newer version (2.14)? The dag I'm running that caused this has `start_date` set to: ``` with DAG( 'Archives

[GitHub] [airflow] t4n1o commented on issue #18541: Error when running dag & something to do with parsing the start date

2021-09-27 Thread GitBox
t4n1o commented on issue #18541: URL: https://github.com/apache/airflow/issues/18541#issuecomment-928440208 Would it help if I upgraded airflow to a newer version (2.14)? The dag I'm running that caused this has start_date set to: ``` with DAG( 'Archives Mirror',

[GitHub] [airflow] ernest-kr commented on pull request #16666: Replace execution_date with run_id in airflow tasks run command

2021-09-27 Thread GitBox
ernest-kr commented on pull request #1: URL: https://github.com/apache/airflow/pull/1#issuecomment-928439654 @SamWheating -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [airflow] ernest-kr commented on pull request #16666: Replace execution_date with run_id in airflow tasks run command

2021-09-27 Thread GitBox
ernest-kr commented on pull request #1: URL: https://github.com/apache/airflow/pull/1#issuecomment-928439191 I see that the CLI help docs are not updated -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use

[GitHub] [airflow] ChristianDavis opened a new pull request #18560: typo in docs

2021-09-27 Thread GitBox
ChristianDavis opened a new pull request #18560: URL: https://github.com/apache/airflow/pull/18560 --- **^ Add meaningful description above** Read the **[Pull Request Guidelines](https://github.com/apache/airflow/blob/main/CONTRIBUTING.rst#pull-request-guidelines)** for

[GitHub] [airflow] boring-cyborg[bot] commented on pull request #18560: typo in docs

2021-09-27 Thread GitBox
boring-cyborg[bot] commented on pull request #18560: URL: https://github.com/apache/airflow/pull/18560#issuecomment-928400554 Congratulations on your first Pull Request and welcome to the Apache Airflow community! If you have any issues or are unsure about any anything please check our

[GitHub] [airflow] rafaelwsan commented on issue #18558: Login failed in UI after setting Postgres external database in the helm chart

2021-09-27 Thread GitBox
rafaelwsan commented on issue #18558: URL: https://github.com/apache/airflow/issues/18558#issuecomment-928360874 All tables were created successfully after chart upgrade, but UI login still fail -- This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [airflow] rafaelwsan commented on issue #18558: Login failed in UI after setting Postgres external database in the helm chart

2021-09-27 Thread GitBox
rafaelwsan commented on issue #18558: URL: https://github.com/apache/airflow/issues/18558#issuecomment-928356991 NAME READY STATUSRESTARTS AGE airflow-pgbouncer-6df5c988f7-xbp7q 2/2 Running 0 26m

[GitHub] [airflow] enriqueayala opened a new issue #18559: dag_run.start_date not available from SubDag

2021-09-27 Thread GitBox
enriqueayala opened a new issue #18559: URL: https://github.com/apache/airflow/issues/18559 ### Apache Airflow version 2.1.4 (latest released) ### Operating System Ubuntu 20.04 ### Versions of Apache Airflow Providers _No response_ ### Deployment

[GitHub] [airflow] rafaelwsan opened a new issue #18558: Login failed in UI after setting Postgres external database in the helm chart

2021-09-27 Thread GitBox
rafaelwsan opened a new issue #18558: URL: https://github.com/apache/airflow/issues/18558 ### Official Helm Chart version 1.1.0 (latest released) ### Apache Airflow version 2.1.2 ### Kubernetes Version 1.20.9 ### Helm Chart configuration #

[GitHub] [airflow] boring-cyborg[bot] commented on issue #18558: Login failed in UI after setting Postgres external database in the helm chart

2021-09-27 Thread GitBox
boring-cyborg[bot] commented on issue #18558: URL: https://github.com/apache/airflow/issues/18558#issuecomment-928345567 Thanks for opening your first issue here! Be sure to follow the issue template! -- This is an automated message from the Apache Git Service. To respond to the

[GitHub] [airflow] ShakaibKhan commented on issue #17962: Warn if robots.txt is accessed

2021-09-27 Thread GitBox
ShakaibKhan commented on issue #17962: URL: https://github.com/apache/airflow/issues/17962#issuecomment-928292345 started pr to address this: https://github.com/apache/airflow/pull/18557 -- This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [airflow] ShakaibKhan opened a new pull request #18557: Warning of public exposure of deployment in UI with on/off config

2021-09-27 Thread GitBox
ShakaibKhan opened a new pull request #18557: URL: https://github.com/apache/airflow/pull/18557 related: #17962 Added warning banner message for when /robot.txt is hit with on/off config -- This is an automated message from the Apache Git Service. To respond to the

[GitHub] [airflow] jedcunningham closed issue #18458: Airflow deployed on Kubernetes cluster NOT showing airflow app metrics in STATSD Exporter

2021-09-27 Thread GitBox
jedcunningham closed issue #18458: URL: https://github.com/apache/airflow/issues/18458 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] flolas edited a comment on pull request #17329: Split sql statements in DbApi run

2021-09-27 Thread GitBox
flolas edited a comment on pull request #17329: URL: https://github.com/apache/airflow/pull/17329#issuecomment-928259116 @potiuk Tests fail :( whats wrong? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[GitHub] [airflow] flolas commented on pull request #17329: Split sql statements in DbApi run

2021-09-27 Thread GitBox
flolas commented on pull request #17329: URL: https://github.com/apache/airflow/pull/17329#issuecomment-928259116 @potiuk Tests fails :( whats wrong? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [airflow] collinmcnulty opened a new pull request #18555: Add task information to logs about k8s pods

2021-09-27 Thread GitBox
collinmcnulty opened a new pull request #18555: URL: https://github.com/apache/airflow/pull/18555 Add annotations, which contain the task information, to log lines that reference a specific pod so that logs can be searched by task or DAG id. Also condenses a few more log elements into a

[GitHub] [airflow] Brooke-white commented on a change in pull request #18447: add RedshiftStatementHook, RedshiftOperator

2021-09-27 Thread GitBox
Brooke-white commented on a change in pull request #18447: URL: https://github.com/apache/airflow/pull/18447#discussion_r716999098 ## File path: airflow/providers/amazon/aws/hooks/redshift_statement.py ## @@ -0,0 +1,144 @@ +# +# Licensed to the Apache Software Foundation (ASF)

[GitHub] [airflow] zachliu commented on issue #15000: When an ECS Task fails to start, ECS Operator raises a CloudWatch exception

2021-09-27 Thread GitBox
zachliu commented on issue #15000: URL: https://github.com/apache/airflow/issues/15000#issuecomment-928219338 > @zachliu @kanga333 did remove retry for now #16150 solved the problem? @eladkal unfortunately no, #16150 was for another issue that's only somewhat related to this one

[GitHub] [airflow] ephraimbuddy commented on a change in pull request #18554: Bugfix: dag_bag.get_dag should not raise exception

2021-09-27 Thread GitBox
ephraimbuddy commented on a change in pull request #18554: URL: https://github.com/apache/airflow/pull/18554#discussion_r716990684 ## File path: airflow/exceptions.py ## @@ -150,10 +150,6 @@ class DuplicateTaskIdFound(AirflowException): """Raise when a Task with duplicate

[GitHub] [airflow] ephraimbuddy edited a comment on pull request #18554: Bugfix: dag_bag.get_dag should not raise exception

2021-09-27 Thread GitBox
ephraimbuddy edited a comment on pull request #18554: URL: https://github.com/apache/airflow/pull/18554#issuecomment-928203949 > The API has been returning 404 for quite some time (and IMO it's the correct behaviour). #18523 only refactored the implementation to raise 404 in a different

[GitHub] [airflow] eladkal commented on issue #12680: SparkSubmitHook - allow log parsing

2021-09-27 Thread GitBox
eladkal commented on issue #12680: URL: https://github.com/apache/airflow/issues/12680#issuecomment-928205522 This feels like a very custom use case for your needs. You can do that with a custom operator. -- This is an automated message from the Apache Git Service. To respond to the

[GitHub] [airflow] eladkal closed issue #12680: SparkSubmitHook - allow log parsing

2021-09-27 Thread GitBox
eladkal closed issue #12680: URL: https://github.com/apache/airflow/issues/12680 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[airflow] branch main updated (892c5fc -> 80ae70c)

2021-09-27 Thread kaxilnaik
This is an automated email from the ASF dual-hosted git repository. kaxilnaik pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git. from 892c5fc Add package filter info to Breeze build docs (#18550) add 80ae70c Fix ``DetachedInstanceError``

[GitHub] [airflow] kaxil merged pull request #18499: Fix DetachedInstanceError when dag_run attrs are accessed from ti

2021-09-27 Thread GitBox
kaxil merged pull request #18499: URL: https://github.com/apache/airflow/pull/18499 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] ephraimbuddy commented on pull request #18554: Bugfix: dag_bag.get_dag should not raise exception

2021-09-27 Thread GitBox
ephraimbuddy commented on pull request #18554: URL: https://github.com/apache/airflow/pull/18554#issuecomment-928203949 > The API has been returning 404 for quite some time (and IMO it's the correct behaviour). #18523 only refactored the implementation to raise 404 in a different way.

[GitHub] [airflow] eladkal commented on issue #15000: When an ECS Task fails to start, ECS Operator raises a CloudWatch exception

2021-09-27 Thread GitBox
eladkal commented on issue #15000: URL: https://github.com/apache/airflow/issues/15000#issuecomment-928203500 @zachliu @kanga333 did remove retry for now #16150 solved the problem? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [airflow] ashb commented on pull request #18503: When calling `dr.get_task_instance` automatically set `dag_run` relationship

2021-09-27 Thread GitBox
ashb commented on pull request #18503: URL: https://github.com/apache/airflow/pull/18503#issuecomment-928202842 We don't need this now with Ephraim's latest pr -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[GitHub] [airflow] ashb closed pull request #18503: When calling `dr.get_task_instance` automatically set `dag_run` relationship

2021-09-27 Thread GitBox
ashb closed pull request #18503: URL: https://github.com/apache/airflow/pull/18503 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] github-actions[bot] commented on pull request #18499: Fix DetachedInstanceError when dag_run attrs are accessed from ti

2021-09-27 Thread GitBox
github-actions[bot] commented on pull request #18499: URL: https://github.com/apache/airflow/pull/18499#issuecomment-928201848 The PR most likely needs to run full matrix of tests because it modifies parts of the core of Airflow. However, committers might decide to merge it quickly and

[GitHub] [airflow] eladkal closed issue #17314: Kerberos configuration to enable allow kinit -f -A

2021-09-27 Thread GitBox
eladkal closed issue #17314: URL: https://github.com/apache/airflow/issues/17314 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] eladkal commented on issue #17314: Kerberos configuration to enable allow kinit -f -A

2021-09-27 Thread GitBox
eladkal commented on issue #17314: URL: https://github.com/apache/airflow/issues/17314#issuecomment-928201286 solved in https://github.com/apache/airflow/pull/17816 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

[GitHub] [airflow] eladkal commented on issue #16919: error when using mysql_to_s3 (TypeError: cannot safely cast non-equivalent object to int64)

2021-09-27 Thread GitBox
eladkal commented on issue #16919: URL: https://github.com/apache/airflow/issues/16919#issuecomment-928199673 @SasanAhmadi are you working on this issue? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

[GitHub] [airflow] dstandish commented on a change in pull request #18447: add RedshiftStatementHook, RedshiftOperator

2021-09-27 Thread GitBox
dstandish commented on a change in pull request #18447: URL: https://github.com/apache/airflow/pull/18447#discussion_r716962976 ## File path: airflow/providers/amazon/aws/hooks/redshift_statement.py ## @@ -0,0 +1,144 @@ +# +# Licensed to the Apache Software Foundation (ASF)

[GitHub] [airflow] dstandish commented on a change in pull request #18447: add RedshiftStatementHook, RedshiftOperator

2021-09-27 Thread GitBox
dstandish commented on a change in pull request #18447: URL: https://github.com/apache/airflow/pull/18447#discussion_r716962976 ## File path: airflow/providers/amazon/aws/hooks/redshift_statement.py ## @@ -0,0 +1,144 @@ +# +# Licensed to the Apache Software Foundation (ASF)

[GitHub] [airflow] dstandish commented on a change in pull request #18447: add RedshiftStatementHook, RedshiftOperator

2021-09-27 Thread GitBox
dstandish commented on a change in pull request #18447: URL: https://github.com/apache/airflow/pull/18447#discussion_r716962976 ## File path: airflow/providers/amazon/aws/hooks/redshift_statement.py ## @@ -0,0 +1,144 @@ +# +# Licensed to the Apache Software Foundation (ASF)

[GitHub] [airflow] dstandish commented on a change in pull request #18447: add RedshiftStatementHook, RedshiftOperator

2021-09-27 Thread GitBox
dstandish commented on a change in pull request #18447: URL: https://github.com/apache/airflow/pull/18447#discussion_r716962976 ## File path: airflow/providers/amazon/aws/hooks/redshift_statement.py ## @@ -0,0 +1,144 @@ +# +# Licensed to the Apache Software Foundation (ASF)

[GitHub] [airflow] uranusjr commented on pull request #18554: Bugfix: dag_bag.get_dag should not raise exception

2021-09-27 Thread GitBox
uranusjr commented on pull request #18554: URL: https://github.com/apache/airflow/pull/18554#issuecomment-928180413 The API has been returning 404 for quite some time (and IMO it's the correct behaviour). #18523 only refactored the implementation to raise 404 in a different way. --

[GitHub] [airflow] ephraimbuddy commented on pull request #18554: Bugfix: dag_bag.get_dag should not raise exception

2021-09-27 Thread GitBox
ephraimbuddy commented on pull request #18554: URL: https://github.com/apache/airflow/pull/18554#issuecomment-928176400 Also, error for missing DAG now returns a REST API not found error: ``` { "detail": null, "status": 404, "title": "DAG 'dag_pod_operatorxco' not

[GitHub] [airflow] mik-laj commented on pull request #17951: Refresh credentials for long-running pods on EKS

2021-09-27 Thread GitBox
mik-laj commented on pull request #17951: URL: https://github.com/apache/airflow/pull/17951#issuecomment-928175875 @potiuk Can you look at it? It is ready for review now. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

[GitHub] [airflow] ephraimbuddy opened a new pull request #18554: Bugfix: dag_bag.get_dag should not raise exception

2021-09-27 Thread GitBox
ephraimbuddy opened a new pull request #18554: URL: https://github.com/apache/airflow/pull/18554 get_dag raising exception is breaking many parts of the codebase. The usage in code suggests that it should return None if a dag is not found. There are about 30 usages expecting it to

[GitHub] [airflow] potiuk commented on pull request #18147: Allow airflow standard images to run in openshift utilising the official helm chart #18136

2021-09-27 Thread GitBox
potiuk commented on pull request #18147: URL: https://github.com/apache/airflow/pull/18147#issuecomment-928152614 Some static/helm unit test failed -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[GitHub] [airflow] jedcunningham closed pull request #18553:  Extra debugging for helm tests

2021-09-27 Thread GitBox
jedcunningham closed pull request #18553: URL: https://github.com/apache/airflow/pull/18553 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] jedcunningham opened a new pull request #18553:  Extra debugging for helm tests

2021-09-27 Thread GitBox
jedcunningham opened a new pull request #18553: URL: https://github.com/apache/airflow/pull/18553 I'm just seeing if I can identify why public runners are failing on -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use

[GitHub] [airflow] andrewgodwin opened a new pull request #18552: Allow core Triggerer loops to yield control

2021-09-27 Thread GitBox
andrewgodwin opened a new pull request #18552: URL: https://github.com/apache/airflow/pull/18552 In the case of having several hundred triggers, the core triggerer creation/deletion loops would block the main thread for several hundred milliseconds and bring the event loop to a halt.

[GitHub] [airflow] Brooke-white commented on a change in pull request #18447: add RedshiftStatementHook, RedshiftOperator

2021-09-27 Thread GitBox
Brooke-white commented on a change in pull request #18447: URL: https://github.com/apache/airflow/pull/18447#discussion_r716879087 ## File path: airflow/providers/amazon/aws/hooks/redshift_statement.py ## @@ -0,0 +1,144 @@ +# +# Licensed to the Apache Software Foundation (ASF)

[GitHub] [airflow] josh-fell commented on a change in pull request #18447: add RedshiftStatementHook, RedshiftOperator

2021-09-27 Thread GitBox
josh-fell commented on a change in pull request #18447: URL: https://github.com/apache/airflow/pull/18447#discussion_r716876359 ## File path: airflow/providers/amazon/aws/hooks/redshift_statement.py ## @@ -0,0 +1,144 @@ +# +# Licensed to the Apache Software Foundation (ASF)

[GitHub] [airflow] mik-laj commented on a change in pull request #18494: Fix part of Google system tests

2021-09-27 Thread GitBox
mik-laj commented on a change in pull request #18494: URL: https://github.com/apache/airflow/pull/18494#discussion_r716873050 ## File path: airflow/providers/google/cloud/example_dags/example_cloud_sql.py ## @@ -48,8 +49,8 @@ from airflow.utils.dates import days_ago

[GitHub] [airflow] mik-laj commented on a change in pull request #18494: Fix part of Google system tests

2021-09-27 Thread GitBox
mik-laj commented on a change in pull request #18494: URL: https://github.com/apache/airflow/pull/18494#discussion_r716870133 ## File path: airflow/providers/google/cloud/example_dags/example_cloud_sql.py ## @@ -48,8 +49,8 @@ from airflow.utils.dates import days_ago

[airflow] branch main updated: Add package filter info to Breeze build docs (#18550)

2021-09-27 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new 892c5fc Add package filter info to Breeze build

[GitHub] [airflow] potiuk merged pull request #18550: Add package filter info to Breeze build docs

2021-09-27 Thread GitBox
potiuk merged pull request #18550: URL: https://github.com/apache/airflow/pull/18550 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] potiuk commented on pull request #18550: Add package filter info to Breeze build docs

2021-09-27 Thread GitBox
potiuk commented on pull request #18550: URL: https://github.com/apache/airflow/pull/18550#issuecomment-928060148 Nice! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

[airflow] branch main updated (a458fcc -> 2fadf3c)

2021-09-27 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git. from a458fcc Updating miscellaneous provider DAGs to use TaskFlow API where applicable (#18278) add 2fadf3c Fix

[GitHub] [airflow] potiuk merged pull request #18548: Fix kubernetes engine system test

2021-09-27 Thread GitBox
potiuk merged pull request #18548: URL: https://github.com/apache/airflow/pull/18548 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[airflow] branch main updated: Updating miscellaneous provider DAGs to use TaskFlow API where applicable (#18278)

2021-09-27 Thread ephraimanierobi
This is an automated email from the ASF dual-hosted git repository. ephraimanierobi pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new a458fcc Updating miscellaneous provider

[GitHub] [airflow] ephraimbuddy merged pull request #18278: Updating miscellaneous provider DAGs to use TaskFlow API where applicable

2021-09-27 Thread GitBox
ephraimbuddy merged pull request #18278: URL: https://github.com/apache/airflow/pull/18278 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] potiuk closed issue #18546: Show code of other files than DAG one

2021-09-27 Thread GitBox
potiuk closed issue #18546: URL: https://github.com/apache/airflow/issues/18546 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] potiuk commented on issue #18546: Show code of other files than DAG one

2021-09-27 Thread GitBox
potiuk commented on issue #18546: URL: https://github.com/apache/airflow/issues/18546#issuecomment-928022140 That is unlikely to happen soon IMHO. It's a dificult one to pull if you consider how Python code is parsed, it would be next-to-impossible to find out which files to

[GitHub] [airflow] potiuk commented on pull request #18516: Fix rendering nested task fields

2021-09-27 Thread GitBox
potiuk commented on pull request #18516: URL: https://github.com/apache/airflow/pull/18516#issuecomment-928006395 > Sorry house full of back to school colds here. Might get to it tomorrow but if @turbaszek is okay don't wait for me Can wait - I think would be good to get it to 2.2

[GitHub] [airflow] jbarnettfreejazz commented on issue #18512: airflow deadlock trying to update rendered_task_instance_fields table (mysql)

2021-09-27 Thread GitBox
jbarnettfreejazz commented on issue #18512: URL: https://github.com/apache/airflow/issues/18512#issuecomment-928004168 Hi -- thanks for jumping on this -- This seems to primarily occur in the DELETE case. We're running MySql version 8.0.23 Here's stack trace info [2021-09-27

[GitHub] [airflow] ashb commented on pull request #18516: Fix rendering nested task fields

2021-09-27 Thread GitBox
ashb commented on pull request #18516: URL: https://github.com/apache/airflow/pull/18516#issuecomment-928002133 Sorry house full of back to school colds here. Might get to it tomorrow but if @turbaszek is okay don't wait for me -- This is an automated message from the Apache Git

[GitHub] [airflow] potiuk commented on pull request #18516: Fix rendering nested task fields

2021-09-27 Thread GitBox
potiuk commented on pull request #18516: URL: https://github.com/apache/airflow/pull/18516#issuecomment-927999280 kind reminder @ashb :) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [airflow] potiuk commented on pull request #18476: Give MSSQL container more time to start up

2021-09-27 Thread GitBox
potiuk commented on pull request #18476: URL: https://github.com/apache/airflow/pull/18476#issuecomment-927998717 I think we have only those - few instable scheduler tests problems left. -- This is an automated message from the Apache Git Service. To respond to the message, please log

[GitHub] [airflow] potiuk edited a comment on pull request #18522: Coerce datetime to pendulum for timetable

2021-09-27 Thread GitBox
potiuk edited a comment on pull request #18522: URL: https://github.com/apache/airflow/pull/18522#issuecomment-927983797 > Grrgh, the diffrent `str()` representation between `datetime.datetime` and `pendulum.DateTime` is super annoying. And yes, let's also add a test when we fix the

[GitHub] [airflow] JavierLopezT commented on pull request #14415: SnowflakeToS3Operator

2021-09-27 Thread GitBox
JavierLopezT commented on pull request #14415: URL: https://github.com/apache/airflow/pull/14415#issuecomment-927983491 Closing. Anytime, I might open a PR with SnowflakeCopyIntoLocationOperator -- This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [airflow] potiuk commented on pull request #18522: Coerce datetime to pendulum for timetable

2021-09-27 Thread GitBox
potiuk commented on pull request #18522: URL: https://github.com/apache/airflow/pull/18522#issuecomment-927983797 > Grrgh, the diffrent `str()` representation between `datetime.datetime` and `pendulum.DateTime` is super annoying. And yes, let's also add a test when we fix the failing one

[GitHub] [airflow] JavierLopezT closed pull request #14415: SnowflakeToS3Operator

2021-09-27 Thread GitBox
JavierLopezT closed pull request #14415: URL: https://github.com/apache/airflow/pull/14415 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] JavierLopezT opened a new pull request #18550: Add package filter info to Breeze build docs

2021-09-27 Thread GitBox
JavierLopezT opened a new pull request #18550: URL: https://github.com/apache/airflow/pull/18550 This was mentioned in git hub actions failure, but I haven't found it in the documentation -- This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [airflow] potiuk commented on pull request #18494: Fix part of Google system tests

2021-09-27 Thread GitBox
potiuk commented on pull request #18494: URL: https://github.com/apache/airflow/pull/18494#issuecomment-927973836 Some static checks failed :( -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [airflow] potiuk commented on a change in pull request #18494: Fix part of Google system tests

2021-09-27 Thread GitBox
potiuk commented on a change in pull request #18494: URL: https://github.com/apache/airflow/pull/18494#discussion_r716791580 ## File path: airflow/providers/google/cloud/example_dags/example_cloud_sql.py ## @@ -48,8 +49,8 @@ from airflow.utils.dates import days_ago

[GitHub] [airflow] Echronix opened a new issue #18549: CloudWatch CreateLogGroup error on already existing LogGroup

2021-09-27 Thread GitBox
Echronix opened a new issue #18549: URL: https://github.com/apache/airflow/issues/18549 ### Apache Airflow version 2.1.2 ### Operating System Ubuntu Docker ### Versions of Apache Airflow Providers apache-airflow-providers-amazon==2.0.0

[GitHub] [airflow] boring-cyborg[bot] commented on issue #18549: CloudWatch CreateLogGroup error on already existing LogGroup

2021-09-27 Thread GitBox
boring-cyborg[bot] commented on issue #18549: URL: https://github.com/apache/airflow/issues/18549#issuecomment-927968278 Thanks for opening your first issue here! Be sure to follow the issue template! -- This is an automated message from the Apache Git Service. To respond to the

[GitHub] [airflow] jj8huang commented on issue #16344: Tried to upgrade to Airflow 2.1.0

2021-09-27 Thread GitBox
jj8huang commented on issue #16344: URL: https://github.com/apache/airflow/issues/16344#issuecomment-927963260 Yes I did! And i ended up getting this error: `Can't locate revision identified by 'ccde3e26fe78'` . Also worth noting that I couldn't find any logs in AWS of the other

[GitHub] [airflow] deedmitrij opened a new pull request #18548: Fix kubernetes engine system test

2021-09-27 Thread GitBox
deedmitrij opened a new pull request #18548: URL: https://github.com/apache/airflow/pull/18548 1. Add `in_cluster=False` argument to `GKEStartPodOperator` 2. Change order of activating service account and setting project -- This is an automated message from the Apache Git Service.

[GitHub] [airflow] jensgrnb commented on issue #18495: apache-airflow-providers-sendgrid==2.0.1 doesn't show in the connections drop down UI

2021-09-27 Thread GitBox
jensgrnb commented on issue #18495: URL: https://github.com/apache/airflow/issues/18495#issuecomment-927960288 Thanks for the code pointer, I'll double check the pasted api key! On Mon, 27 Sept 2021 at 16:51, Jarek Potiuk ***@***.***> wrote: > I did not use sendgrid so I am

[airflow] branch main updated (387c43f -> 391da64)

2021-09-27 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git. from 387c43f Fix intermittent orphan test (#18530) add 391da64 Excludes rightfullhy unlicensed files from chart

[GitHub] [airflow] potiuk merged pull request #18547: Excludes rightfullhy unlicensed files from chart from RAT check

2021-09-27 Thread GitBox
potiuk merged pull request #18547: URL: https://github.com/apache/airflow/pull/18547 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] potiuk commented on issue #18495: apache-airflow-providers-sendgrid==2.0.1 doesn't show in the connections drop down UI

2021-09-27 Thread GitBox
potiuk commented on issue #18495: URL: https://github.com/apache/airflow/issues/18495#issuecomment-927951133 I did not use sendgrid so I am not sure but from the code it looks like API_KEY is taken from connection password. I do not think host is ever used. You just have to make sure your

[GitHub] [airflow] github-actions[bot] commented on pull request #18547: Excludes rightfullhy unlicensed files from chart from RAT check

2021-09-27 Thread GitBox
github-actions[bot] commented on pull request #18547: URL: https://github.com/apache/airflow/pull/18547#issuecomment-927945440 The PR is likely ready to be merged. No tests are needed as no important environment files, nor python files were modified by it. However, committers might decide

[GitHub] [airflow] potiuk opened a new pull request #18547: Excludes rightfullhy unlicensed files from chart from RAT check

2021-09-27 Thread GitBox
potiuk opened a new pull request #18547: URL: https://github.com/apache/airflow/pull/18547 --- **^ Add meaningful description above** Read the **[Pull Request Guidelines](https://github.com/apache/airflow/blob/main/CONTRIBUTING.rst#pull-request-guidelines)** for more

  1   2   >