[GitHub] [airflow] boring-cyborg[bot] commented on issue #17123: sqlalchemy.exc.OperationalError: (psycopg2.errors.UndefinedFile) could not open file

2021-07-20 Thread GitBox
boring-cyborg[bot] commented on issue #17123: URL: https://github.com/apache/airflow/issues/17123#issuecomment-883908696 Thanks for opening your first issue here! Be sure to follow the issue template! -- This is an automated message from the Apache Git Service. To respond to the

[GitHub] [airflow] deswandhi opened a new issue #17123: sqlalchemy.exc.OperationalError: (psycopg2.errors.UndefinedFile) could not open file

2021-07-20 Thread GitBox
deswandhi opened a new issue #17123: URL: https://github.com/apache/airflow/issues/17123 **Apache Airflow version**: **Kubernetes version (if you are using kubernetes)** (use `kubectl version`): **Environment**: - **Cloud provider or hardware

[GitHub] [airflow] uranusjr opened a new pull request #17122: AIP-39: Add schedule_date to OpenAPI DAGRun schema

2021-07-20 Thread GitBox
uranusjr opened a new pull request #17122: URL: https://github.com/apache/airflow/pull/17122 I tried renaming `DagRun.execution_date` to `schedule_date` and it produced a plethora of errors everywhere, so I’m taking a less drastic attempt on this. This PR adds a `schedule_date`

[GitHub] [airflow] ashoksahoo commented on pull request #16754: Only allow webserver to request from the worker log server

2021-07-20 Thread GitBox
ashoksahoo commented on pull request #16754: URL: https://github.com/apache/airflow/pull/16754#issuecomment-883879822 I also faced the same issue and was not able to solve it, I downgraded to 2.1.1 in the chart for now. Can we create a Issue and track it for 2.1.3 -- This is an

[GitHub] [airflow] aa1371 commented on a change in pull request #16829: Queue support for DaskExecutor using Dask Worker Resources

2021-07-20 Thread GitBox
aa1371 commented on a change in pull request #16829: URL: https://github.com/apache/airflow/pull/16829#discussion_r673627247 ## File path: airflow/executors/dask_executor.py ## @@ -81,7 +81,22 @@ def airflow_run(): if not self.client: raise

[GitHub] [airflow] aa1371 commented on a change in pull request #16829: Queue support for DaskExecutor using Dask Worker Resources

2021-07-20 Thread GitBox
aa1371 commented on a change in pull request #16829: URL: https://github.com/apache/airflow/pull/16829#discussion_r673627247 ## File path: airflow/executors/dask_executor.py ## @@ -81,7 +81,22 @@ def airflow_run(): if not self.client: raise

[GitHub] [airflow] aa1371 commented on a change in pull request #16829: Queue support for DaskExecutor using Dask Worker Resources

2021-07-20 Thread GitBox
aa1371 commented on a change in pull request #16829: URL: https://github.com/apache/airflow/pull/16829#discussion_r673627247 ## File path: airflow/executors/dask_executor.py ## @@ -81,7 +81,22 @@ def airflow_run(): if not self.client: raise

[GitHub] [airflow] aa1371 commented on a change in pull request #16829: Queue support for DaskExecutor using Dask Worker Resources

2021-07-20 Thread GitBox
aa1371 commented on a change in pull request #16829: URL: https://github.com/apache/airflow/pull/16829#discussion_r673627247 ## File path: airflow/executors/dask_executor.py ## @@ -81,7 +81,22 @@ def airflow_run(): if not self.client: raise

[GitHub] [airflow] SamWheating opened a new pull request #17121: [WIP] Deactivating DAGs which have been removed from files

2021-07-20 Thread GitBox
SamWheating opened a new pull request #17121: URL: https://github.com/apache/airflow/pull/17121 Closes: https://github.com/apache/airflow/issues/11901 Ensuring that the active DAGs in the DB are all actually present in their corresponding python files by reconciling the DB

[GitHub] [airflow] uranusjr closed issue #8494: TriggerDagOperator sometimes causes database to trigger UniqueViolation constraint

2021-07-20 Thread GitBox
uranusjr closed issue #8494: URL: https://github.com/apache/airflow/issues/8494 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] uranusjr commented on issue #8494: TriggerDagOperator sometimes causes database to trigger UniqueViolation constraint

2021-07-20 Thread GitBox
uranusjr commented on issue #8494: URL: https://github.com/apache/airflow/issues/8494#issuecomment-883837925 1.10 has reached end of line, so I’m going to close this unless someone reproduces this on the 2.x series. -- This is an automated message from the Apache Git Service. To respond

[GitHub] [airflow] MatteoMart1994 edited a comment on issue #8494: TriggerDagOperator sometimes causes database to trigger UniqueViolation constraint

2021-07-20 Thread GitBox
MatteoMart1994 edited a comment on issue #8494: URL: https://github.com/apache/airflow/issues/8494#issuecomment-883413320 Issue still met in composer-1-15-0-airflow-1-10-12. ``` Traceback (most recent call last) File "/usr/local/lib/airflow/airflow/models/dagrun.py", line

[GitHub] [airflow] uranusjr commented on pull request #17117: Made S3ToRedshiftOperator transaction safe

2021-07-20 Thread GitBox
uranusjr commented on pull request #17117: URL: https://github.com/apache/airflow/pull/17117#issuecomment-883825614 Could you also rename the variable since it’s no longer a truncate statement? -- This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [airflow] uranusjr commented on issue #17054: Unable to trigger a DAG run via stable rest api

2021-07-20 Thread GitBox
uranusjr commented on issue #17054: URL: https://github.com/apache/airflow/issues/17054#issuecomment-883824422 Would you be able to get what `post_body` is when this happens? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

[GitHub] [airflow] SimonOsipov opened a new pull request #16636: Added dashes to pod naming

2021-07-20 Thread GitBox
SimonOsipov opened a new pull request #16636: URL: https://github.com/apache/airflow/pull/16636 Closes: #16600 --- In order to have a more readable naming of KubernetesExecutor Pod, decided to remove deleting "dashes" as per the

[GitHub] [airflow] uranusjr commented on pull request #16636: Added dashes to pod naming

2021-07-20 Thread GitBox
uranusjr commented on pull request #16636: URL: https://github.com/apache/airflow/pull/16636#issuecomment-883822361 #17057 only covers the `kubernetes_helper_functions.py` part of this PR; we still need other parts of this. -- This is an automated message from the Apache Git Service. To

[GitHub] [airflow] gastonlau opened a new issue #17120: [Scheduler error] psycopg2.OperationalError: SSL SYSCALL error: Socket operation on non-socket

2021-07-20 Thread GitBox
gastonlau opened a new issue #17120: URL: https://github.com/apache/airflow/issues/17120 Hi Airflow Team, I am running the Airflow in an EC2 instance which is installed by conda-forge during the Code Deploy. After upgrading the Airflow version from 2.0.2 to >=2.1.0, I am facing

[GitHub] [airflow] boring-cyborg[bot] commented on issue #17120: [Scheduler error] psycopg2.OperationalError: SSL SYSCALL error: Socket operation on non-socket

2021-07-20 Thread GitBox
boring-cyborg[bot] commented on issue #17120: URL: https://github.com/apache/airflow/issues/17120#issuecomment-883822012 Thanks for opening your first issue here! Be sure to follow the issue template! -- This is an automated message from the Apache Git Service. To respond to the

[GitHub] [airflow] uranusjr commented on pull request #16980: Change pod id notation back to hyphen

2021-07-20 Thread GitBox
uranusjr commented on pull request #16980: URL: https://github.com/apache/airflow/pull/16980#issuecomment-883821712 Oh, not really, this addresses some cases not covered by #17057 (nor #16636!) so we still need this PR. -- This is an automated message from the Apache Git Service. To

[GitHub] [airflow] dave-martinez commented on issue #17077: Problem with task_run and secrets mask

2021-07-20 Thread GitBox
dave-martinez commented on issue #17077: URL: https://github.com/apache/airflow/issues/17077#issuecomment-883820931 Encountered the same issue, and was able to fix it with @potiuk explanation. Sharing my experience for people who use custom logging. SecretsMasker is now needed for

[GitHub] [airflow] uranusjr commented on pull request #16980: Change pod id notation back to hyphen

2021-07-20 Thread GitBox
uranusjr commented on pull request #16980: URL: https://github.com/apache/airflow/pull/16980#issuecomment-883820861 Actually I think the final solution implemented in #17057 happens to also cover this? -- This is an automated message from the Apache Git Service. To respond to the

[GitHub] [airflow] uranusjr closed pull request #16980: Change pod id notation back to hyphen

2021-07-20 Thread GitBox
uranusjr closed pull request #16980: URL: https://github.com/apache/airflow/pull/16980 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] uranusjr closed pull request #16636: Added dashes to pod naming

2021-07-20 Thread GitBox
uranusjr closed pull request #16636: URL: https://github.com/apache/airflow/pull/16636 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] uranusjr commented on pull request #16636: Added dashes to pod naming

2021-07-20 Thread GitBox
uranusjr commented on pull request #16636: URL: https://github.com/apache/airflow/pull/16636#issuecomment-883820693 I think #17057 covers this. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [airflow] mik-laj commented on issue #17111: apache-airflow-providers-google: google-ads-12.0.0

2021-07-20 Thread GitBox
mik-laj commented on issue #17111: URL: https://github.com/apache/airflow/issues/17111#issuecomment-883793326 We had compatibility problem with newer version of Google ads library, because it requires Python 3.7 or newer, but we supports Python 3.6. Hopefully it has been fixed. They added

[GitHub] [airflow] mik-laj commented on a change in pull request #16571: Implemented Basic EKS Integration

2021-07-20 Thread GitBox
mik-laj commented on a change in pull request #16571: URL: https://github.com/apache/airflow/pull/16571#discussion_r673574757 ## File path: airflow/providers/amazon/aws/hooks/eks.py ## @@ -0,0 +1,346 @@ +# Licensed to the Apache Software Foundation (ASF) under one +# or more

[GitHub] [airflow] github-actions[bot] commented on pull request #15610: Add SystemsManagerParameterStoreJsonBackend

2021-07-20 Thread GitBox
github-actions[bot] commented on pull request #15610: URL: https://github.com/apache/airflow/pull/15610#issuecomment-883784052 This pull request has been automatically marked as stale because it has not had recent activity. It will be closed in 5 days if no further activity occurs. Thank

[GitHub] [airflow] uranusjr commented on a change in pull request #17118: Use `dag_maker` fixture in test_backfill_job.py

2021-07-20 Thread GitBox
uranusjr commented on a change in pull request #17118: URL: https://github.com/apache/airflow/pull/17118#discussion_r673567264 ## File path: tests/jobs/test_backfill_job.py ## @@ -71,14 +71,14 @@ def set_instance_attrs(self, dag_bag): self.parser =

[GitHub] [airflow] zorzigio commented on issue #15540: git-sync with persistent volume claim

2021-07-20 Thread GitBox
zorzigio commented on issue #15540: URL: https://github.com/apache/airflow/issues/15540#issuecomment-883779031 Solved the issue adding `noperm` to the `StorageClass` `mountOptions` ```yaml kind: StorageClass apiVersion: storage.k8s.io/v1 metadata: name:

[GitHub] [airflow] ephraimbuddy opened a new pull request #17118: Use `dag_maker` fixture in test_backfill_job.py

2021-07-20 Thread GitBox
ephraimbuddy opened a new pull request #17118: URL: https://github.com/apache/airflow/pull/17118 This change uses the dag_maker fixture in tests --- **^ Add meaningful description above** Read the **[Pull Request

[GitHub] [airflow] jedcunningham commented on pull request #17115: Correct the :mod: documentation for s3_to_redshift_operator

2021-07-20 Thread GitBox
jedcunningham commented on pull request #17115: URL: https://github.com/apache/airflow/pull/17115#issuecomment-883757458 Thanks @troyharvey! Congrats on your first commit  -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

[GitHub] [airflow] jedcunningham commented on pull request #16980: Change pod id notation back to hyphen

2021-07-20 Thread GitBox
jedcunningham commented on pull request #16980: URL: https://github.com/apache/airflow/pull/16980#issuecomment-883755990 @dimon222, this effort is already underway in #16636. Maybe you could coordinate with @simonosipov to see if you can collaborate? -- This is an automated message from

[airflow] branch main updated (960da8a -> eb3d685)

2021-07-20 Thread jedcunningham
This is an automated email from the ASF dual-hosted git repository. jedcunningham pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git. from 960da8a Switch test_backfill_job.py from unittest to pytest style (#17112) add eb3d685 Correct the

[GitHub] [airflow] jedcunningham merged pull request #17115: Correct the :mod: documentation for s3_to_redshift_operator

2021-07-20 Thread GitBox
jedcunningham merged pull request #17115: URL: https://github.com/apache/airflow/pull/17115 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] boring-cyborg[bot] commented on pull request #17115: Correct the :mod: documentation for s3_to_redshift_operator

2021-07-20 Thread GitBox
boring-cyborg[bot] commented on pull request #17115: URL: https://github.com/apache/airflow/pull/17115#issuecomment-883757222 Awesome work, congrats on your first merged pull request! -- This is an automated message from the Apache Git Service. To respond to the message, please log

[GitHub] [airflow] HardikVijayPatel commented on issue #15364: There is a vulnerability in jquery 3.4.1 ,upgrade recommended

2021-07-20 Thread GitBox
HardikVijayPatel commented on issue #15364: URL: https://github.com/apache/airflow/issues/15364#issuecomment-883742042 @kaxil this fix has got moved from airflow 2.1.2 to 2.1.3, is that right? as i don't see the issue mentioned in change log for the 2.1.2 release:

[GitHub] [airflow] pyerbiz edited a comment on issue #11912: Add how-to Guide for Azure operators

2021-07-20 Thread GitBox
pyerbiz edited a comment on issue #11912: URL: https://github.com/apache/airflow/issues/11912#issuecomment-883675512 @potiuk Curious why was below PR done? https://github.com/apache/airflow/pull/15651 -- This is an automated message from the Apache Git Service. To respond to the

[GitHub] [airflow] kaxil commented on issue #17054: Unable to trigger a DAG run via stable rest api

2021-07-20 Thread GitBox
kaxil commented on issue #17054: URL: https://github.com/apache/airflow/issues/17054#issuecomment-883734727 hmm, I tried with 2.1.0 too couldn't reproduce. cc @ephraimbuddy can you reproduce with 2.1.0? -- This is an automated message from the Apache Git Service. To respond to the

[GitHub] [airflow] iicky commented on issue #10331: Warnings about refusal to delete permissions on XComModelView

2021-07-20 Thread GitBox
iicky commented on issue #10331: URL: https://github.com/apache/airflow/issues/10331#issuecomment-883727588 Same here for version 2.1.2 - just appeared on upgrade. ``` [2021-07-20 21:40:46,109] {manager.py:565} WARNING - Refused to delete permission view, assoc with role exists

[GitHub] [airflow] zorzigio commented on issue #15540: git-sync with persistent volume claim

2021-07-20 Thread GitBox
zorzigio commented on issue #15540: URL: https://github.com/apache/airflow/issues/15540#issuecomment-883727318 @jedcunningham finally I got round to try this. I created a custom storage class using ```yaml kind: StorageClass apiVersion: storage.k8s.io/v1 metadata:

[GitHub] [airflow] ferruzzi edited a comment on pull request #16571: Implemented Basic EKS Integration

2021-07-20 Thread GitBox
ferruzzi edited a comment on pull request #16571: URL: https://github.com/apache/airflow/pull/16571#issuecomment-883716102 Pushed the system tests. They will all skip because the logic for passing/parsing the credentials is not implemented in `provide_aws_context()`, but that feels like

[GitHub] [airflow] ferruzzi commented on pull request #16571: Implemented Basic EKS Integration

2021-07-20 Thread GitBox
ferruzzi commented on pull request #16571: URL: https://github.com/apache/airflow/pull/16571#issuecomment-883716102 Pushed the system tests. They will all skip because the logic for passing/parsing the credentials is not implemented in `provide_aws_context()`, but that feels like it

[GitHub] [airflow] pyerbiz commented on issue #11912: Add how-to Guide for Azure operators

2021-07-20 Thread GitBox
pyerbiz commented on issue #11912: URL: https://github.com/apache/airflow/issues/11912#issuecomment-883708140 Missing Doc List **Provider_file,Example,Doc,Doc-Action** adls_delete.py,1,1,rename doc adls_list.py,0,0 adx.py,0,0 azure_batch.py,0,0

[GitHub] [airflow] github-actions[bot] commented on pull request #17116: Prepares docs for Rc2 release of July providers

2021-07-20 Thread GitBox
github-actions[bot] commented on pull request #17116: URL: https://github.com/apache/airflow/pull/17116#issuecomment-883707239 The PR is likely OK to be merged with just subset of tests for default Python and Database versions without running the full matrix of tests, because it does not

[GitHub] [airflow] oyarushe opened a new pull request #17117: Made S3ToRedshiftOperator transaction safe

2021-07-20 Thread GitBox
oyarushe opened a new pull request #17117: URL: https://github.com/apache/airflow/pull/17117 Made S3ToRedshiftOperator transaction safe. Now all SQL statements are running in one transaction. Closes: #14888. --- **^ Add meaningful description above** Read the

[airflow] branch main updated (3a7c764 -> 960da8a)

2021-07-20 Thread ephraimanierobi
This is an automated email from the ASF dual-hosted git repository. ephraimanierobi pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git. from 3a7c764 Fixing typo for render_template_as_native_obj (#17114) add 960da8a Switch

[GitHub] [airflow] ephraimbuddy merged pull request #17112: Switch test_backfill_job.py from unittest to pytest style

2021-07-20 Thread GitBox
ephraimbuddy merged pull request #17112: URL: https://github.com/apache/airflow/pull/17112 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] pyerbiz edited a comment on issue #11912: Add how-to Guide for Azure operators

2021-07-20 Thread GitBox
pyerbiz edited a comment on issue #11912: URL: https://github.com/apache/airflow/issues/11912#issuecomment-883675512 Curious why was this PR done? https://github.com/apache/airflow/pull/15651 -- This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [airflow] potiuk opened a new pull request #17116: Prepares docs for Rc2 release of July providers

2021-07-20 Thread GitBox
potiuk opened a new pull request #17116: URL: https://github.com/apache/airflow/pull/17116 --- **^ Add meaningful description above** Read the **[Pull Request Guidelines](https://github.com/apache/airflow/blob/main/CONTRIBUTING.rst#pull-request-guidelines)** for more

[GitHub] [airflow] baryluk commented on pull request #17105: Ensure a DAG is acyclic when running DAG.cli()

2021-07-20 Thread GitBox
baryluk commented on pull request #17105: URL: https://github.com/apache/airflow/pull/17105#issuecomment-883636065 @uranusjr Thank you! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [airflow] brain-buster commented on pull request #17082: #16976 Add json.dumps() for templated fields objects: 'dict' and 'list'

2021-07-20 Thread GitBox
brain-buster commented on pull request #17082: URL: https://github.com/apache/airflow/pull/17082#issuecomment-883635047 > Should be easy to cherry-pick. Marked it as 2.1.3 provisionally It will be awesome! Thanks -- This is an automated message from the Apache Git Service. To

[GitHub] [airflow] github-actions[bot] commented on pull request #17115: Correct the :mod: documentation for s3_to_redshift_operator

2021-07-20 Thread GitBox
github-actions[bot] commented on pull request #17115: URL: https://github.com/apache/airflow/pull/17115#issuecomment-883632232 The PR most likely needs to run full matrix of tests because it modifies parts of the core of Airflow. However, committers might decide to merge it quickly and

[GitHub] [airflow] potiuk commented on pull request #17082: #16976 Add json.dumps() for templated fields objects: 'dict' and 'list'

2021-07-20 Thread GitBox
potiuk commented on pull request #17082: URL: https://github.com/apache/airflow/pull/17082#issuecomment-883631558 Should be easy to cherry-pick. Marked it as 2.1.3 provisionally -- This is an automated message from the Apache Git Service. To respond to the message, please log on to

[airflow] branch main updated (7c0d8a2 -> 3a7c764)

2021-07-20 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git. from 7c0d8a2 Add Pytest fixture to create dag and dagrun and use it on local task job tests (#16889) add 3a7c764

[GitHub] [airflow] github-actions[bot] commented on pull request #17114: Fixing typo for render_template_as_native_obj docstring

2021-07-20 Thread GitBox
github-actions[bot] commented on pull request #17114: URL: https://github.com/apache/airflow/pull/17114#issuecomment-883630416 The PR most likely needs to run full matrix of tests because it modifies parts of the core of Airflow. However, committers might decide to merge it quickly and

[GitHub] [airflow] potiuk merged pull request #17114: Fixing typo for render_template_as_native_obj docstring

2021-07-20 Thread GitBox
potiuk merged pull request #17114: URL: https://github.com/apache/airflow/pull/17114 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] vladm commented on pull request #17082: #16976 Add json.dumps() for templated fields objects: 'dict' and 'list'

2021-07-20 Thread GitBox
vladm commented on pull request #17082: URL: https://github.com/apache/airflow/pull/17082#issuecomment-883622713 Any chance this is pulled into next 2.1.X release? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

[GitHub] [airflow] jedcunningham edited a comment on pull request #17041: Chart: Update ``postgres`` subchart to ``10.5.3``

2021-07-20 Thread GitBox
jedcunningham edited a comment on pull request #17041: URL: https://github.com/apache/airflow/pull/17041#issuecomment-883614918 Going to rerun chart unit tests to see if they still fail. (just noticed this was moved to draft ) -- This is an automated message from the Apache Git

[GitHub] [airflow] jedcunningham closed pull request #17041: Chart: Update ``postgres`` subchart to ``10.5.3``

2021-07-20 Thread GitBox
jedcunningham closed pull request #17041: URL: https://github.com/apache/airflow/pull/17041 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] jedcunningham commented on pull request #17041: Chart: Update ``postgres`` subchart to ``10.5.3``

2021-07-20 Thread GitBox
jedcunningham commented on pull request #17041: URL: https://github.com/apache/airflow/pull/17041#issuecomment-883614918 Going to rerun chart unit tests to see if they still fail. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [airflow] potiuk edited a comment on issue #17111: apache-airflow-providers-google: google-ads-12.0.0

2021-07-20 Thread GitBox
potiuk edited a comment on issue #17111: URL: https://github.com/apache/airflow/issues/17111#issuecomment-883611771 Seems like you might have @Overbryd to help you at least with testing. The more, the merrier ! -- This is an automated message from the Apache Git Service. To respond to

[GitHub] [airflow] potiuk commented on issue #17111: apache-airflow-providers-google: google-ads-12.0.0

2021-07-20 Thread GitBox
potiuk commented on issue #17111: URL: https://github.com/apache/airflow/issues/17111#issuecomment-883611771 Seems like you might have @Overbyrd to help you at least with testing. The more, the merrier ! -- This is an automated message from the Apache Git Service. To respond to the

[GitHub] [airflow] boring-cyborg[bot] commented on pull request #17115: Correct the :mod: documentation for s3_to_redshift_operator

2021-07-20 Thread GitBox
boring-cyborg[bot] commented on pull request #17115: URL: https://github.com/apache/airflow/pull/17115#issuecomment-883611596 Congratulations on your first Pull Request and welcome to the Apache Airflow community! If you have any issues or are unsure about any anything please check our

[GitHub] [airflow] troyharvey opened a new pull request #17115: Correct the :mod: documentation for s3_to_redshift_operator

2021-07-20 Thread GitBox
troyharvey opened a new pull request #17115: URL: https://github.com/apache/airflow/pull/17115 ### Problem `airflow.providers.amazon.aws.operators.s3_to_redshift` is referenced in the docs but it does not exist. ### Solution Update module to

[GitHub] [airflow] andormarkus commented on issue #13824: Cloudwatch Integration: SIGTERM/SIGKILL Sent Following DAG Completion, Causing Errors in Worker Logs

2021-07-20 Thread GitBox
andormarkus commented on issue #13824: URL: https://github.com/apache/airflow/issues/13824#issuecomment-883591250 Hi @ephraimbuddy I still having the same issue. Logs are the same airflow.cfg ```bash [scheduler] dag_dir_list_interval = 60

[GitHub] [airflow] potiuk commented on pull request #16754: Only allow webserver to request from the worker log server

2021-07-20 Thread GitBox
potiuk commented on pull request #16754: URL: https://github.com/apache/airflow/pull/16754#issuecomment-883590588 > Also when using airflow helm chart `secret_key` ends up being different between the pods unless it is explicitly specified in values.yaml, so maybe update helm chart

[GitHub] [airflow] potiuk closed issue #17113: apache-airflow-providers-google locks google-ads to an unsupported version

2021-07-20 Thread GitBox
potiuk closed issue #17113: URL: https://github.com/apache/airflow/issues/17113 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] potiuk commented on issue #17113: apache-airflow-providers-google locks google-ads to an unsupported version

2021-07-20 Thread GitBox
potiuk commented on issue #17113: URL: https://github.com/apache/airflow/issues/17113#issuecomment-883589153 Duplicate of #17111. @Overbryd closing this one as duplicate - if you would like you can provide a PR to fix that one or you can agree with @rv-irosario to join the forces and

[GitHub] [airflow] github-actions[bot] commented on pull request #17112: Switch test_backfill_job.py from unittest to pytest style

2021-07-20 Thread GitBox
github-actions[bot] commented on pull request #17112: URL: https://github.com/apache/airflow/pull/17112#issuecomment-883587374 The PR most likely needs to run full matrix of tests because it modifies parts of the core of Airflow. However, committers might decide to merge it quickly and

[GitHub] [airflow] rv-irosario commented on issue #17111: apache-airflow-providers-google: google-ads-12.0.0

2021-07-20 Thread GitBox
rv-irosario commented on issue #17111: URL: https://github.com/apache/airflow/issues/17111#issuecomment-883587278 for sure! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

[GitHub] [airflow] potiuk commented on issue #17111: apache-airflow-providers-google: google-ads-12.0.0

2021-07-20 Thread GitBox
potiuk commented on issue #17111: URL: https://github.com/apache/airflow/issues/17111#issuecomment-883585978 Would you like to make a PR and upgrade the dependency? It should be pretty much as easy as updating the dependency and fixing all errors that are resulting from that + runiing a

[GitHub] [airflow] potiuk closed issue #17104: Resource usage in Airflow monitor metrix

2021-07-20 Thread GitBox
potiuk closed issue #17104: URL: https://github.com/apache/airflow/issues/17104 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] potiuk commented on issue #17104: Resource usage in Airflow monitor metrix

2021-07-20 Thread GitBox
potiuk commented on issue #17104: URL: https://github.com/apache/airflow/issues/17104#issuecomment-883580028 Resource monitoring is not really part of airflow -it's outside of the domain of Airflow. You could bring that under discussion at the devlist if you want to ask for opinion of the

[GitHub] [airflow] ephraimbuddy merged pull request #16889: Add Pytest fixture to create dag and dagrun and use it on local task job tests

2021-07-20 Thread GitBox
ephraimbuddy merged pull request #16889: URL: https://github.com/apache/airflow/pull/16889 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[airflow] branch main updated (9b3bfe6 -> 7c0d8a2)

2021-07-20 Thread ephraimanierobi
This is an automated email from the ASF dual-hosted git repository. ephraimanierobi pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git. from 9b3bfe6 Ensure a DAG is acyclic when running DAG.cli() (#17105) add 7c0d8a2 Add Pytest fixture to

[GitHub] [airflow] josh-fell opened a new pull request #17114: Fixing typo for render_template_as_native_obj docstring

2021-07-20 Thread GitBox
josh-fell opened a new pull request #17114: URL: https://github.com/apache/airflow/pull/17114 In a [previous PR](https://github.com/apache/airflow/pull/16534), the `render_template_as_native_obj` parameter was added to the `airflow.models.dag` docstring. However, there is a small typo --

[GitHub] [airflow] potiuk edited a comment on issue #17102: Incorrect python version used for 2.1.2-python3.9 docker image

2021-07-20 Thread GitBox
potiuk edited a comment on issue #17102: URL: https://github.com/apache/airflow/issues/17102#issuecomment-883566372 This was the only manual step I had to do to prepare v2-1 tests for release back then :( . There's a reason why I like automation.. ``` docker run -it

[GitHub] [airflow] potiuk commented on issue #17102: Incorrect python version used for 2.1.2-python3.9 docker image

2021-07-20 Thread GitBox
potiuk commented on issue #17102: URL: https://github.com/apache/airflow/issues/17102#issuecomment-883566372 This was the only manual step I had to do to prepare v2-1 tests for release back then :( . There's a reason why I like automation.. ``` docker run -it

[GitHub] [airflow] potiuk closed issue #17102: Incorrect python version used for 2.1.2-python3.9 docker image

2021-07-20 Thread GitBox
potiuk closed issue #17102: URL: https://github.com/apache/airflow/issues/17102 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] potiuk commented on issue #17102: Incorrect python version used for 2.1.2-python3.9 docker image

2021-07-20 Thread GitBox
potiuk commented on issue #17102: URL: https://github.com/apache/airflow/issues/17102#issuecomment-883552935 Yep. I know exactly what happened. Our base python image I manually pushed to v2-1-test `apache/airflow-ci:python3.9-v2-1-test` is actualy 3.8.10 :(. Fixing it. -- This is an

[GitHub] [airflow] potiuk commented on issue #17102: Incorrect python version used for 2.1.2-python3.9 docker image

2021-07-20 Thread GitBox
potiuk commented on issue #17102: URL: https://github.com/apache/airflow/issues/17102#issuecomment-883548808 aaH! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

[GitHub] [airflow] Aakcht commented on pull request #16754: Only allow webserver to request from the worker log server

2021-07-20 Thread GitBox
Aakcht commented on pull request #16754: URL: https://github.com/apache/airflow/pull/16754#issuecomment-883543410 > Or something that you found in the documentation? Should we make it very explicit in our documentation that you are not supposed to selectively set some configuration

[GitHub] [airflow] Overbryd opened a new issue #17113: apache-airflow-providers-google locks google-ads to an unsupported version

2021-07-20 Thread GitBox
Overbryd opened a new issue #17113: URL: https://github.com/apache/airflow/issues/17113 The `apache-airflow-providers-google` package locks the `google-ads` package to an unsupported version. The maximum supported Google Ads API with the Apache Airflow google provider package is

[GitHub] [airflow] AvniM commented on issue #17054: Unable to trigger a DAG run via stable rest api

2021-07-20 Thread GitBox
AvniM commented on issue #17054: URL: https://github.com/apache/airflow/issues/17054#issuecomment-883540531 @kaxil We are on Airflow 2.1.0. We haven't upgraded to 2.1.2 yet. Can you try reproducing it in v2.1.0 ? -- This is an automated message from the Apache Git Service. To

[GitHub] [airflow] AvniM commented on issue #17054: Unable to trigger a DAG run via stable rest api

2021-07-20 Thread GitBox
AvniM commented on issue #17054: URL: https://github.com/apache/airflow/issues/17054#issuecomment-883540014 @pkuca No luck. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

[GitHub] [airflow] ephraimbuddy opened a new pull request #17112: Switch test_backfill_job.py from unittest to pytest style

2021-07-20 Thread GitBox
ephraimbuddy opened a new pull request #17112: URL: https://github.com/apache/airflow/pull/17112 Prep work to use pytest fixtures in tests Following https://github.com/apache/airflow/pull/17053 --- **^ Add meaningful description above** Read the **[Pull Request

[GitHub] [airflow] VijayantSoni commented on pull request #9011: Changing from Resource to Client for EC2 and adding support for filters

2021-07-20 Thread GitBox
VijayantSoni commented on pull request #9011: URL: https://github.com/apache/airflow/pull/9011#issuecomment-883532307 @RosterIn Unable to re-request review from you, not sure why so explicitly tagging you, please review. -- This is an automated message from the Apache Git Service. To

[GitHub] [airflow] VijayantSoni edited a comment on pull request #9011: Changing from Resource to Client for EC2 and adding support for filters

2021-07-20 Thread GitBox
VijayantSoni edited a comment on pull request #9011: URL: https://github.com/apache/airflow/pull/9011#issuecomment-861567170 > Needs back-compat, and I'm not sure what real benefit this gives us. Yeah, I am planning to pick this up soon. > I.e. why do we need this change?

[jira] [Commented] (AIRFLOW-2219) Race condition to DagRun.verify_integrity between Scheduler and Webserver

2021-07-20 Thread Matteo Martignon (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-2219?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17384374#comment-17384374 ] Matteo Martignon commented on AIRFLOW-2219: --- Experiencing the same issue in 

[GitHub] [airflow] ephraimbuddy closed pull request #16889: Add Pytest fixture to create dag and dagrun and use it on local task job tests

2021-07-20 Thread GitBox
ephraimbuddy closed pull request #16889: URL: https://github.com/apache/airflow/pull/16889 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] boring-cyborg[bot] commented on issue #17111: apache-airflow-providers-google: google-ads-12.0.0

2021-07-20 Thread GitBox
boring-cyborg[bot] commented on issue #17111: URL: https://github.com/apache/airflow/issues/17111#issuecomment-883499576 Thanks for opening your first issue here! Be sure to follow the issue template! -- This is an automated message from the Apache Git Service. To respond to the

[GitHub] [airflow] rv-irosario opened a new issue #17111: apache-airflow-providers-google: google-ads-12.0.0

2021-07-20 Thread GitBox
rv-irosario opened a new issue #17111: URL: https://github.com/apache/airflow/issues/17111 Hey team, I was looking to use the google ads hook but it seems like the google ads package is a bit out of date with the hook only taking "v5", "v4", "v3", "v2"

[GitHub] [airflow] MatteoMart1994 edited a comment on issue #8494: TriggerDagOperator sometimes causes database to trigger UniqueViolation constraint

2021-07-20 Thread GitBox
MatteoMart1994 edited a comment on issue #8494: URL: https://github.com/apache/airflow/issues/8494#issuecomment-883413320 Issue still met in composer-1-15-0-airflow-1-10-12. `Traceback (most recent call last) File "/usr/local/lib/airflow/airflow/models/dagrun.py", line 470,

[GitHub] [airflow] fjetter commented on a change in pull request #16829: Queue support for DaskExecutor using Dask Worker Resources

2021-07-20 Thread GitBox
fjetter commented on a change in pull request #16829: URL: https://github.com/apache/airflow/pull/16829#discussion_r673227899 ## File path: airflow/executors/dask_executor.py ## @@ -81,7 +81,22 @@ def airflow_run(): if not self.client: raise

[GitHub] [airflow] MatteoMart1994 edited a comment on issue #8494: TriggerDagOperator sometimes causes database to trigger UniqueViolation constraint

2021-07-20 Thread GitBox
MatteoMart1994 edited a comment on issue #8494: URL: https://github.com/apache/airflow/issues/8494#issuecomment-883413320 Issue still met in composer-1-15-0-airflow-1-10-12. `Traceback (most recent call last) File "/usr/local/lib/airflow/airflow/models/dagrun.py", line 470,

[GitHub] [airflow] ephraimbuddy edited a comment on issue #13824: Cloudwatch Integration: SIGTERM/SIGKILL Sent Following DAG Completion, Causing Errors in Worker Logs

2021-07-20 Thread GitBox
ephraimbuddy edited a comment on issue #13824: URL: https://github.com/apache/airflow/issues/13824#issuecomment-883431785 @andormarkus can you set this: `AIRFLOW__SCHEDULER__ORPHANED_TASKS_CHECK_INTERVAL=84600` and let me know the result? If this worked for you, you should remove

[GitHub] [airflow] mik-laj commented on a change in pull request #16795: GCP Dataflow - Fixed getting job status by job id

2021-07-20 Thread GitBox
mik-laj commented on a change in pull request #16795: URL: https://github.com/apache/airflow/pull/16795#discussion_r673217705 ## File path: airflow/providers/apache/beam/example_dags/example_beam.py ## @@ -309,7 +309,7 @@ wait_for_python_job_dataflow_runner_async_done =

[GitHub] [airflow] ephraimbuddy commented on issue #13824: Cloudwatch Integration: SIGTERM/SIGKILL Sent Following DAG Completion, Causing Errors in Worker Logs

2021-07-20 Thread GitBox
ephraimbuddy commented on issue #13824: URL: https://github.com/apache/airflow/issues/13824#issuecomment-883431785 @andormarkus can you set this: `AIRFLOW__SCHEDULER__ORPHANED_TASKS_CHECK_INTERVAL=84600` and let me know the result? -- This is an automated message from the Apache Git

[GitHub] [airflow] kosteev commented on issue #10331: Warnings about refusal to delete permissions on XComModelView

2021-07-20 Thread GitBox
kosteev commented on issue #10331: URL: https://github.com/apache/airflow/issues/10331#issuecomment-883428660 For Airflow 2.1.1 similar warnings are seen in the logs: """ WARNING - Refused to delete permission view, assoc with role exists My Profile.userinfoedit Admin WARNING -

[GitHub] [airflow] MatteoMart1994 commented on issue #8494: TriggerDagOperator sometimes causes database to trigger UniqueViolation constraint

2021-07-20 Thread GitBox
MatteoMart1994 commented on issue #8494: URL: https://github.com/apache/airflow/issues/8494#issuecomment-883413320 Issue still met in composer-1-15-0-airflow-1-10-12 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use

  1   2   3   4   5   6   >