[GitHub] [airflow] eladkal commented on issue #10786: DatabricksRunNowOperator missing jar_params as a kwarg

2021-10-13 Thread GitBox
eladkal commented on issue #10786: URL: https://github.com/apache/airflow/issues/10786#issuecomment-942989894 @neil90 Would you like to finish the PR you started? I can help with review. -- This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [airflow] pasan1992 commented on issue #18908: Schedular fails during initalization.

2021-10-13 Thread GitBox
pasan1992 commented on issue #18908: URL: https://github.com/apache/airflow/issues/18908#issuecomment-942966982 @potiuk It seems that the Postgres version I have posted in the question was invalid, I updated the question with the correct version. It is 14.0 (Debian 14.0-1.pgdg110+1)

[GitHub] [airflow] boring-cyborg[bot] commented on issue #18969: Trino JWT Authentication Support

2021-10-13 Thread GitBox
boring-cyborg[bot] commented on issue #18969: URL: https://github.com/apache/airflow/issues/18969#issuecomment-942953550 Thanks for opening your first issue here! Be sure to follow the issue template! -- This is an automated message from the Apache Git Service. To respond to the

[GitHub] [airflow] harlequin opened a new issue #18969: Trino JWT Authentication Support

2021-10-13 Thread GitBox
harlequin opened a new issue #18969: URL: https://github.com/apache/airflow/issues/18969 ### Description Would be great to support JWT Authentication in Trino Hook (which also can be used for presto hook). For example like this ``` elif extra.get('auth') ==

[GitHub] [airflow] rchangj commented on issue #17558: New job fail immediately after start, no logs

2021-10-13 Thread GitBox
rchangj commented on issue #17558: URL: https://github.com/apache/airflow/issues/17558#issuecomment-942945813 This issue shows on version 2.1.2 as well. There is no logs of any error shows up. As I mentioned earlier, following command "sudo /sbin/runuser -l -c "airflow scheduler" can be a

[GitHub] [airflow] boring-cyborg[bot] commented on pull request #18968: Suggestion to change DagRun.find in trigger_dag to use execution_date instead of run_id

2021-10-13 Thread GitBox
boring-cyborg[bot] commented on pull request #18968: URL: https://github.com/apache/airflow/pull/18968#issuecomment-942945651 Congratulations on your first Pull Request and welcome to the Apache Airflow community! If you have any issues or are unsure about any anything please check our

[GitHub] [airflow] gulshngill opened a new pull request #18968: Suggestion to change DagRun.find in trigger_dag to use execution_date instead of run_id

2021-10-13 Thread GitBox
gulshngill opened a new pull request #18968: URL: https://github.com/apache/airflow/pull/18968 A small suggestion to change `DagRun.find` in `trigger_dag` to use `execution_date` as a parameter rather than `run_id`. I feel it would make more sense to use this rather than `run_id` as

[GitHub] [airflow] gbonazzoli opened a new issue #18967: Airflow 2.2.0 : Connection Type Oracle returns "ORA-00923: FROM keyword not found where expected" as the result of pressing the "new" button "T

2021-10-13 Thread GitBox
gbonazzoli opened a new issue #18967: URL: https://github.com/apache/airflow/issues/18967 ### Apache Airflow version 2.2.0 (latest released) ### Operating System Ubuntu 20.04.3 LTS ### Versions of Apache Airflow Providers

[GitHub] [airflow] gbonazzoli commented on issue #18965: Upgrading from version 2.1.4 to 2.2.0 fails during postgres db upgrade with error The task_instance table has 1392 rows without a corresponding

2021-10-13 Thread GitBox
gbonazzoli commented on issue #18965: URL: https://github.com/apache/airflow/issues/18965#issuecomment-942930608 I found the solution to delete the offending records: ``` delete FROM task_instance where (execution_date, task_id, dag_id) in ( SELECT task_instance.execution_date,

[GitHub] [airflow] alexbegg edited a comment on pull request #18866: Display current date and seconds in the UI clock

2021-10-13 Thread GitBox
alexbegg edited a comment on pull request #18866: URL: https://github.com/apache/airflow/pull/18866#issuecomment-942927226 I am going to add that I am looking for a feature like this. In my case I would like the date shown, but I prefer not seeing the seconds (less motion on the UI). I

[GitHub] [airflow] alexbegg commented on pull request #18866: Display current date and seconds in the UI clock

2021-10-13 Thread GitBox
alexbegg commented on pull request #18866: URL: https://github.com/apache/airflow/pull/18866#issuecomment-942927226 I am going to add that I am looking for a feature like this. In my case I would like the date shown, but I prefer not seeing the seconds (less motion on the UI). I think a

[GitHub] [airflow] mrkm4ntr opened a new pull request #18966: Support regional GKE cluster

2021-10-13 Thread GitBox
mrkm4ntr opened a new pull request #18966: URL: https://github.com/apache/airflow/pull/18966 Currently GKE related operators support only zonal clusters. This PR makes those operators to support regional clusters. --- **^ Add meaningful description above** Read the

[GitHub] [airflow] gbonazzoli opened a new issue #18965: Upgrading from version 2.1.4 to 2.2.0 fails during postgres db upgrade with error The task_instance table has 1392 rows without a corresponding

2021-10-13 Thread GitBox
gbonazzoli opened a new issue #18965: URL: https://github.com/apache/airflow/issues/18965 ### Apache Airflow version 2.2.0 (latest released) ### Operating System Ubuntu 20.04.3 LTS ### Versions of Apache Airflow Providers

[GitHub] [airflow] dstandish edited a comment on pull request #17142: Chart: Create a random secret for Webserver's flask secret key

2021-10-13 Thread GitBox
dstandish edited a comment on pull request #17142: URL: https://github.com/apache/airflow/pull/17142#issuecomment-942889154 i noticed some secrets are defined under `data`: ```yaml # Airflow database & redis config data: # If secret names are provided, use those secrets

[GitHub] [airflow] dstandish edited a comment on pull request #17142: Chart: Create a random secret for Webserver's flask secret key

2021-10-13 Thread GitBox
dstandish edited a comment on pull request #17142: URL: https://github.com/apache/airflow/pull/17142#issuecomment-942889154 i noticed some secrets are defined under `data`: ```yaml # Airflow database & redis config data: # If secret names are provided, use those secrets

[GitHub] [airflow] dstandish commented on pull request #17142: Chart: Create a random secret for Webserver's flask secret key

2021-10-13 Thread GitBox
dstandish commented on pull request #17142: URL: https://github.com/apache/airflow/pull/17142#issuecomment-942889154 i noticed some secrets are defined under `data`: ```yaml # Airflow database & redis config data: # If secret names are provided, use those secrets

[GitHub] [airflow] easontm commented on issue #18756: Kubernete executor: fetch log failed, no retries on task when task pod is DELETED while running

2021-10-13 Thread GitBox
easontm commented on issue #18756: URL: https://github.com/apache/airflow/issues/18756#issuecomment-942882070 I believe I'm experiencing a similar issue. Occasionally in my deployment, task pods fail to create due to k8s environmental reasons. To a degree this can't be helped by me, and I

[GitHub] [airflow] easontm commented on issue #16982: Tasks fail and do not log due to backend DB (dead?)lock

2021-10-13 Thread GitBox
easontm commented on issue #16982: URL: https://github.com/apache/airflow/issues/16982#issuecomment-942876501 Sorry for the late reply, yes. Also as an update, I'm no longer experiencing deadlock on 2.1.4. However I haven't verified that if deadlock _does_ occur, if the task has a more

[airflow] branch constraints-main updated: Updating constraints. Build id:1339831121

2021-10-13 Thread github-bot
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a commit to branch constraints-main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/constraints-main by this push: new 5c72763 Updating

[GitHub] [airflow] guotongfei commented on pull request #18755: MySQLToS3Operator add support for parquet format

2021-10-13 Thread GitBox
guotongfei commented on pull request #18755: URL: https://github.com/apache/airflow/pull/18755#issuecomment-942850888 Hi @eladkal @uranusjr It seems that all tests have passed and I am wondering what the next step is? Thanks! -- This is an automated message from the Apache Git

[GitHub] [airflow] github-actions[bot] commented on issue #17558: New job fail immediately after start, no logs

2021-10-13 Thread GitBox
github-actions[bot] commented on issue #17558: URL: https://github.com/apache/airflow/issues/17558#issuecomment-942810493 This issue has been automatically marked as stale because it has been open for 30 days with no response from the author. It will be closed in next 7 days if no further

[GitHub] [airflow] uranusjr commented on a change in pull request #18964: Add pre-commit hook for common misspelling check in files

2021-10-13 Thread GitBox
uranusjr commented on a change in pull request #18964: URL: https://github.com/apache/airflow/pull/18964#discussion_r728527040 ## File path: airflow/providers/microsoft/azure/operators/wasb_delete_blob.py ## @@ -65,7 +65,7 @@ def __init__( self.ignore_if_missing =

[GitHub] [airflow] github-actions[bot] commented on pull request #18956: Fix XCom.delete error in Airflow 2.2.0

2021-10-13 Thread GitBox
github-actions[bot] commented on pull request #18956: URL: https://github.com/apache/airflow/pull/18956#issuecomment-942804562 The PR most likely needs to run full matrix of tests because it modifies parts of the core of Airflow. However, committers might decide to merge it quickly and

[GitHub] [airflow] ephraimbuddy commented on a change in pull request #18964: Add pre-commit hook for common misspelling check in files

2021-10-13 Thread GitBox
ephraimbuddy commented on a change in pull request #18964: URL: https://github.com/apache/airflow/pull/18964#discussion_r728526601 ## File path: docs/apache-airflow/pipeline_example.csv ## @@ -87,7 +87,7 @@ Serial Number,Company Name,Employee Markme,Description,Leave

[GitHub] [airflow] ephraimbuddy commented on a change in pull request #18964: Add pre-commit hook for common misspelling check in files

2021-10-13 Thread GitBox
ephraimbuddy commented on a change in pull request #18964: URL: https://github.com/apache/airflow/pull/18964#discussion_r728526225 ## File path: airflow/providers/microsoft/azure/operators/wasb_delete_blob.py ## @@ -65,7 +65,7 @@ def __init__( self.ignore_if_missing =

[GitHub] [airflow] uranusjr commented on a change in pull request #18964: Add pre-commit hook for common misspelling check in files

2021-10-13 Thread GitBox
uranusjr commented on a change in pull request #18964: URL: https://github.com/apache/airflow/pull/18964#discussion_r728524249 ## File path: docs/spelling_wordlist.txt ## @@ -527,6 +529,7 @@ changelog charset checklicence checksums +childs Review comment: This is a

[GitHub] [airflow] yiga2 commented on pull request #18915: Add custom entrypoint documentation

2021-10-13 Thread GitBox
yiga2 commented on pull request #18915: URL: https://github.com/apache/airflow/pull/18915#issuecomment-942802491 I still believe there is an use case for executing stuff BEFORE the entrypoint. In our case, we override the DB pointer dynamically, depending on some values in the ENV -> can

[GitHub] [airflow] ephraimbuddy commented on a change in pull request #18964: Add pre-commit hook for common misspelling check in files

2021-10-13 Thread GitBox
ephraimbuddy commented on a change in pull request #18964: URL: https://github.com/apache/airflow/pull/18964#discussion_r728523776 ## File path: docs/spelling_wordlist.txt ## @@ -1025,6 +1030,7 @@ ok okta onboarded onkill +ons Review comment: The `ons` is in

[GitHub] [airflow] jedcunningham commented on a change in pull request #18964: Add pre-commit hook for common misspelling check in files

2021-10-13 Thread GitBox
jedcunningham commented on a change in pull request #18964: URL: https://github.com/apache/airflow/pull/18964#discussion_r728520799 ## File path: docs/spelling_wordlist.txt ## @@ -1025,6 +1030,7 @@ ok okta onboarded onkill +ons Review comment: I'm a little confused

[GitHub] [airflow] mik-laj commented on issue #18963: Missing value for new before_send config causes airflow.exceptions.AirflowConfigException: section/key [sentry/before_send] not found in config

2021-10-13 Thread GitBox
mik-laj commented on issue #18963: URL: https://github.com/apache/airflow/issues/18963#issuecomment-942797344 @leonsmith can you look at it? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [airflow] ephraimbuddy opened a new pull request #18964: Add pre-commit hook for common misspelling check in files

2021-10-13 Thread GitBox
ephraimbuddy opened a new pull request #18964: URL: https://github.com/apache/airflow/pull/18964 This PR adds codespell to the pre-commit hooks. This will specifically help us a bit in resolving sphinx errors. From the project page: It does not check for word membership in a

[airflow] branch main updated: Test kubernetes refresh config (#18563)

2021-10-13 Thread kamilbregula
This is an automated email from the ASF dual-hosted git repository. kamilbregula pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new a6be597 Test kubernetes refresh config

[GitHub] [airflow] mik-laj merged pull request #18563: Test kubernetes refresh config

2021-10-13 Thread GitBox
mik-laj merged pull request #18563: URL: https://github.com/apache/airflow/pull/18563 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] mik-laj closed issue #15526: Improve test coverage of Kubernetes config_refresh

2021-10-13 Thread GitBox
mik-laj closed issue #15526: URL: https://github.com/apache/airflow/issues/15526 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] boring-cyborg[bot] commented on issue #18963: Missing value for new before_send config causes airflow.exceptions.AirflowConfigException: section/key [sentry/before_send] not found i

2021-10-13 Thread GitBox
boring-cyborg[bot] commented on issue #18963: URL: https://github.com/apache/airflow/issues/18963#issuecomment-942774326 Thanks for opening your first issue here! Be sure to follow the issue template! -- This is an automated message from the Apache Git Service. To respond to the

[GitHub] [airflow] joshzana opened a new issue #18963: Missing value for new before_send config causes airflow.exceptions.AirflowConfigException: section/key [sentry/before_send] not found in config

2021-10-13 Thread GitBox
joshzana opened a new issue #18963: URL: https://github.com/apache/airflow/issues/18963 ### Apache Airflow version 2.2.0 (latest released) ### Operating System Ubuntu 20.04.3 LTS ### Versions of Apache Airflow Providers

[GitHub] [airflow] dstandish edited a comment on issue #16684: Helm Chart Allow for Empty data settings

2021-10-13 Thread GitBox
dstandish edited a comment on issue #16684: URL: https://github.com/apache/airflow/issues/16684#issuecomment-942772689 I too see the value in allowing components of the `standard_airflow_environment` to be sourced in a way other than k8s secret. One reason is, if it's an officially

[GitHub] [airflow] dstandish commented on issue #16684: Helm Chart Allow for Empty data settings

2021-10-13 Thread GitBox
dstandish commented on issue #16684: URL: https://github.com/apache/airflow/issues/16684#issuecomment-942772689 I too see the value in allowing components of the `standard_airflow_environment` to be sourced in a way other than k8s secret. One reason is, if it's an officially

[GitHub] [airflow] BBAtSFP opened a new issue #18962: Please mention AirFlow wordings in documentation & add "Exec specific DAG" role example

2021-10-13 Thread GitBox
BBAtSFP opened a new issue #18962: URL: https://github.com/apache/airflow/issues/18962 ### Describe the issue with documentation 1. The [permissions documentation](https://airflow.apache.org/docs/apache-airflow/stable/security/access-control.html#dag-level-permissions) does not

[GitHub] [airflow] boring-cyborg[bot] commented on issue #18962: Please mention AirFlow wordings in documentation & add "Exec specific DAG" role example

2021-10-13 Thread GitBox
boring-cyborg[bot] commented on issue #18962: URL: https://github.com/apache/airflow/issues/18962#issuecomment-942760338 Thanks for opening your first issue here! Be sure to follow the issue template! -- This is an automated message from the Apache Git Service. To respond to the

[GitHub] [airflow] mik-laj commented on a change in pull request #18945: Add dataproc metastore operators

2021-10-13 Thread GitBox
mik-laj commented on a change in pull request #18945: URL: https://github.com/apache/airflow/pull/18945#discussion_r728417941 ## File path: airflow/providers/google/cloud/example_dags/example_dataproc_metastore.py ## @@ -0,0 +1,202 @@ +# +# Licensed to the Apache Software

[GitHub] [airflow] josh-fell commented on a change in pull request #18945: Add dataproc metastore operators

2021-10-13 Thread GitBox
josh-fell commented on a change in pull request #18945: URL: https://github.com/apache/airflow/pull/18945#discussion_r728464727 ## File path: airflow/providers/google/cloud/example_dags/example_dataproc_metastore.py ## @@ -0,0 +1,202 @@ +# +# Licensed to the Apache Software

[GitHub] [airflow] mik-laj commented on issue #18959: [ui] Use name of variable or connection in delete confirmation box

2021-10-13 Thread GitBox
mik-laj commented on issue #18959: URL: https://github.com/apache/airflow/issues/18959#issuecomment-942733944 This message is defined in Flask-AppBuilder, so this change could be a bit complicated.

[GitHub] [airflow] khalidmammadov opened a new pull request #18961: Convert www.security test suite to pytest and remove residuals

2021-10-13 Thread GitBox
khalidmammadov opened a new pull request #18961: URL: https://github.com/apache/airflow/pull/18961 This PR addresses number of issues: - Converts www.test_security suite to pytest - Clears up test users, roles and permission on completion of the test I tried to keep tests as

[airflow] branch constraints-main updated: Updating constraints. Build id:1339102956

2021-10-13 Thread github-bot
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a commit to branch constraints-main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/constraints-main by this push: new fc80351 Updating

[GitHub] [airflow] guotongfei removed a comment on pull request #18755: MySQLToS3Operator add support for parquet format

2021-10-13 Thread GitBox
guotongfei removed a comment on pull request #18755: URL: https://github.com/apache/airflow/pull/18755#issuecomment-942462592 Hi @eladkal @uranusjr It looks like all the tests have passed, and I am wondering what the next step is? Thank you! -- This is an automated message from

[GitHub] [airflow] mik-laj commented on a change in pull request #18945: Add dataproc metastore operators

2021-10-13 Thread GitBox
mik-laj commented on a change in pull request #18945: URL: https://github.com/apache/airflow/pull/18945#discussion_r728417941 ## File path: airflow/providers/google/cloud/example_dags/example_dataproc_metastore.py ## @@ -0,0 +1,202 @@ +# +# Licensed to the Apache Software

[GitHub] [airflow] drobert opened a new pull request #18960: Update CSV ingest code for tutorial

2021-10-13 Thread GitBox
drobert opened a new pull request #18960: URL: https://github.com/apache/airflow/pull/18960 The 'tutorial' basic ETL example at https://airflow.apache.org/docs/apache-airflow/stable/tutorial.html#testing is not functional. This PR: - allows the file save path to be

[GitHub] [airflow] boring-cyborg[bot] commented on pull request #18960: Update CSV ingest code for tutorial

2021-10-13 Thread GitBox
boring-cyborg[bot] commented on pull request #18960: URL: https://github.com/apache/airflow/pull/18960#issuecomment-942724409 Congratulations on your first Pull Request and welcome to the Apache Airflow community! If you have any issues or are unsure about any anything please check our

[GitHub] [airflow] fritz-astronomer commented on issue #18582: Allow Pools to be set via ENV

2021-10-13 Thread GitBox
fritz-astronomer commented on issue #18582: URL: https://github.com/apache/airflow/issues/18582#issuecomment-942718143 Yea @thcidale0808 - I imagine that would fit the needs of the individuals I've talked to with this. The ENV does it's best to ADD or UPDATE pools. Users will be made

[GitHub] [airflow] thcidale0808 commented on issue #18582: Allow Pools to be set via ENV

2021-10-13 Thread GitBox
thcidale0808 commented on issue #18582: URL: https://github.com/apache/airflow/issues/18582#issuecomment-942716168 @fritz-astronomer are you happy with the scope/assumptions raised by @SamWheating here: https://github.com/apache/airflow/issues/18582#issuecomment-931473731 ? -- This is

[GitHub] [airflow] SamWheating commented on a change in pull request #18945: Add dataproc metastore operators

2021-10-13 Thread GitBox
SamWheating commented on a change in pull request #18945: URL: https://github.com/apache/airflow/pull/18945#discussion_r728442051 ## File path: airflow/providers/google/cloud/operators/dataproc_metastore.py ## @@ -0,0 +1,1046 @@ +# +# Licensed to the Apache Software Foundation

[GitHub] [airflow] drobert edited a comment on issue #18950: Basic tutorial example has many bugs

2021-10-13 Thread GitBox
drobert edited a comment on issue #18950: URL: https://github.com/apache/airflow/issues/18950#issuecomment-942711225 > I think changing the title to "Basic tutorial examples could be improved". reflects a bit better the actual state of it @potiuk I did not intend to make this sound

[GitHub] [airflow] drobert commented on issue #18950: Basic tutorial example has many bugs

2021-10-13 Thread GitBox
drobert commented on issue #18950: URL: https://github.com/apache/airflow/issues/18950#issuecomment-942711225 > I think changing the title to "Basic tutorial examples could be improved". reflects a bit better the actual state of it @potiuk I did not intend to make this sound

[GitHub] [airflow] xuan616 commented on pull request #18927: Support query timeout as an argument in CassandraToGCSOperator

2021-10-13 Thread GitBox
xuan616 commented on pull request #18927: URL: https://github.com/apache/airflow/pull/18927#issuecomment-942705039 Hi @uranusjr, changes were made per the suggestion. Please let me know if you have any concern. -- This is an automated message from the Apache Git Service. To respond to

[GitHub] [airflow] xuan616 commented on issue #18921: Add query timeout as an argument in CassandraToGCSOperator

2021-10-13 Thread GitBox
xuan616 commented on issue #18921: URL: https://github.com/apache/airflow/issues/18921#issuecomment-942701837 does it ^ intend to move query execution into cassandra hook? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

[GitHub] [airflow] mik-laj commented on a change in pull request #18916: Add role export/import to cli tools

2021-10-13 Thread GitBox
mik-laj commented on a change in pull request #18916: URL: https://github.com/apache/airflow/pull/18916#discussion_r728425680 ## File path: tests/cli/commands/test_role_command.py ## @@ -81,3 +82,27 @@ def test_cli_list_roles(self): def

[GitHub] [airflow] mik-laj commented on a change in pull request #18945: Add dataproc metastore operators

2021-10-13 Thread GitBox
mik-laj commented on a change in pull request #18945: URL: https://github.com/apache/airflow/pull/18945#discussion_r728417941 ## File path: airflow/providers/google/cloud/example_dags/example_dataproc_metastore.py ## @@ -0,0 +1,202 @@ +# +# Licensed to the Apache Software

[GitHub] [airflow] mik-laj commented on a change in pull request #18945: Add dataproc metastore operators

2021-10-13 Thread GitBox
mik-laj commented on a change in pull request #18945: URL: https://github.com/apache/airflow/pull/18945#discussion_r728417941 ## File path: airflow/providers/google/cloud/example_dags/example_dataproc_metastore.py ## @@ -0,0 +1,202 @@ +# +# Licensed to the Apache Software

[GitHub] [airflow] mik-laj commented on a change in pull request #18945: Add dataproc metastore operators

2021-10-13 Thread GitBox
mik-laj commented on a change in pull request #18945: URL: https://github.com/apache/airflow/pull/18945#discussion_r728417941 ## File path: airflow/providers/google/cloud/example_dags/example_dataproc_metastore.py ## @@ -0,0 +1,202 @@ +# +# Licensed to the Apache Software

[GitHub] [airflow] mik-laj commented on a change in pull request #18945: Add dataproc metastore operators

2021-10-13 Thread GitBox
mik-laj commented on a change in pull request #18945: URL: https://github.com/apache/airflow/pull/18945#discussion_r728417941 ## File path: airflow/providers/google/cloud/example_dags/example_dataproc_metastore.py ## @@ -0,0 +1,202 @@ +# +# Licensed to the Apache Software

[GitHub] [airflow] potiuk commented on pull request #9011: Adding support for using client_type API for interacting with EC2 and support for using filters

2021-10-13 Thread GitBox
potiuk commented on pull request #9011: URL: https://github.com/apache/airflow/pull/9011#issuecomment-942687180 @ashb? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

[airflow] branch main updated: Refactor SSHOperator so a subclass can run many commands (#10874) (#17378)

2021-10-13 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new 73fcbb0 Refactor SSHOperator so a subclass can

[GitHub] [airflow] potiuk merged pull request #17378: Refactor SSHOperator so a subclass can run many commands (#10874)

2021-10-13 Thread GitBox
potiuk merged pull request #17378: URL: https://github.com/apache/airflow/pull/17378 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] potiuk closed issue #10874: SSHHook get_conn() does not re-use client

2021-10-13 Thread GitBox
potiuk closed issue #10874: URL: https://github.com/apache/airflow/issues/10874 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] potiuk commented on issue #18746: dagrun_time doesn't trigger on_failure_callback

2021-10-13 Thread GitBox
potiuk commented on issue #18746: URL: https://github.com/apache/airflow/issues/18746#issuecomment-942683519 Ah yeah. Just see it now. Actually timeout cancels running task and on_failure_callback is not called. You can open a new feature request - maybe it would make sense to have

[GitHub] [airflow] potiuk closed issue #18746: dagrun_time doesn't trigger on_failure_callback

2021-10-13 Thread GitBox
potiuk closed issue #18746: URL: https://github.com/apache/airflow/issues/18746 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] jameslamb commented on issue #18959: [ui] Use name of variable or connection in delete confirmation box

2021-10-13 Thread GitBox
jameslamb commented on issue #18959: URL: https://github.com/apache/airflow/issues/18959#issuecomment-942664726 I didn't see a place in the GitHub Form to add thisI checked "willing to submit a PR" because I am willing to do the work if maintainers are open to the feature, but I'm

[GitHub] [airflow] ephraimbuddy commented on issue #17507: Task processes killed with WARNING - Recorded pid does not match the current pid

2021-10-13 Thread GitBox
ephraimbuddy commented on issue #17507: URL: https://github.com/apache/airflow/issues/17507#issuecomment-942664387 > @ephraimbuddy I posted code which can reproduce the error in #18041 if you haven't seen it yet. I tried your code but couldn't reproduce it locally. I do not have an

[GitHub] [airflow] jameslamb opened a new issue #18959: [ui] Use name of variable or connection in delete confirmation box

2021-10-13 Thread GitBox
jameslamb opened a new issue #18959: URL: https://github.com/apache/airflow/issues/18959 ### Description As of Airflow 2.1.0, when you click the trash can in the UI to delete a Variable or Connection, the following confirmation box appears.

[GitHub] [airflow] boring-cyborg[bot] commented on issue #18959: [ui] Use name of variable or connection in delete confirmation box

2021-10-13 Thread GitBox
boring-cyborg[bot] commented on issue #18959: URL: https://github.com/apache/airflow/issues/18959#issuecomment-942663407 Thanks for opening your first issue here! Be sure to follow the issue template! -- This is an automated message from the Apache Git Service. To respond to the

[GitHub] [airflow] stephenonethree commented on issue #17507: Task processes killed with WARNING - Recorded pid does not match the current pid

2021-10-13 Thread GitBox
stephenonethree commented on issue #17507: URL: https://github.com/apache/airflow/issues/17507#issuecomment-942661376 @ephraimbuddy I posted code which can reproduce the error in #18041 if you haven't seen it yet. -- This is an automated message from the Apache Git Service. To respond

[airflow] branch main updated (f0e2143 -> 306d060)

2021-10-13 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git. from f0e2143 Check python version before starting triggerer (#18926) add 306d060 Add ``semver`` to devel deps

[GitHub] [airflow] potiuk merged pull request #18818: Add ``semver`` to devel deps

2021-10-13 Thread GitBox
potiuk merged pull request #18818: URL: https://github.com/apache/airflow/pull/18818 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[airflow] branch main updated: Check python version before starting triggerer (#18926)

2021-10-13 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new f0e2143 Check python version before starting

[GitHub] [airflow] potiuk merged pull request #18926: Check python version before starting triggerer

2021-10-13 Thread GitBox
potiuk merged pull request #18926: URL: https://github.com/apache/airflow/pull/18926 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[airflow] branch main updated: Adding feature in bash operator to append the user defined env variable to system env variable (#18944)

2021-10-13 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new d4a3d2b Adding feature in bash operator to append

[GitHub] [airflow] potiuk closed issue #17240: bash operator overrides environment variables instead of updating them

2021-10-13 Thread GitBox
potiuk closed issue #17240: URL: https://github.com/apache/airflow/issues/17240 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] boring-cyborg[bot] commented on pull request #18944: Adding feature in bash operator to append the user defined env variable to system env variable

2021-10-13 Thread GitBox
boring-cyborg[bot] commented on pull request #18944: URL: https://github.com/apache/airflow/pull/18944#issuecomment-942647610 Awesome work, congrats on your first merged pull request! -- This is an automated message from the Apache Git Service. To respond to the message, please log

[GitHub] [airflow] potiuk merged pull request #18944: Adding feature in bash operator to append the user defined env variable to system env variable

2021-10-13 Thread GitBox
potiuk merged pull request #18944: URL: https://github.com/apache/airflow/pull/18944 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] potiuk commented on issue #18846: Scheduler stops running: psycopg2.OperationalError: SSL SYSCALL error: EOF detected

2021-10-13 Thread GitBox
potiuk commented on issue #18846: URL: https://github.com/apache/airflow/issues/18846#issuecomment-942644206 Not that I am aware of, -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [airflow] potiuk commented on issue #18950: Basic tutorial example has many bugs

2021-10-13 Thread GitBox
potiuk commented on issue #18950: URL: https://github.com/apache/airflow/issues/18950#issuecomment-942637333 Feel free -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

[GitHub] [airflow] ephraimbuddy commented on issue #17507: Task processes killed with WARNING - Recorded pid does not match the current pid

2021-10-13 Thread GitBox
ephraimbuddy commented on issue #17507: URL: https://github.com/apache/airflow/issues/17507#issuecomment-942634889 > @ashb & @ephraimbuddy As we faced this issue when using two schedulers running in the same time under Airflow 1.10.X with sensors. Can this be a side effect within Airflow

[GitHub] [airflow] josh-fell commented on a change in pull request #17421: Add ShortCircuitOperator configurability for respecting downstream trigger rules

2021-10-13 Thread GitBox
josh-fell commented on a change in pull request #17421: URL: https://github.com/apache/airflow/pull/17421#discussion_r728367726 ## File path: airflow/operators/python.py ## @@ -185,16 +186,37 @@ def execute(self, context: Dict): class ShortCircuitOperator(PythonOperator,

[GitHub] [airflow] kaxil commented on pull request #18955: Adds Pendulum 1.x -> 2.x upgrade documentation

2021-10-13 Thread GitBox
kaxil commented on pull request #18955: URL: https://github.com/apache/airflow/pull/18955#issuecomment-942626441 Static check is failing -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [airflow] josh-fell commented on a change in pull request #18945: Add dataproc metastore operators

2021-10-13 Thread GitBox
josh-fell commented on a change in pull request #18945: URL: https://github.com/apache/airflow/pull/18945#discussion_r728360759 ## File path: airflow/providers/google/cloud/example_dags/example_dataproc_metastore.py ## @@ -0,0 +1,202 @@ +# +# Licensed to the Apache Software

[GitHub] [airflow] potiuk commented on pull request #18954: Add DAG file processing description to Scheduler Concepts

2021-10-13 Thread GitBox
potiuk commented on pull request #18954: URL: https://github.com/apache/airflow/pull/18954#issuecomment-942545423 I think this is much needed - even if small paragraph to add. Looks good to me but likely @ashb can take a close look there, as there are some nitty-gritty details and some

[GitHub] [airflow] jedcunningham closed issue #15986: Deleting a DagRun from UI does not delete its associated tasks

2021-10-13 Thread GitBox
jedcunningham closed issue #15986: URL: https://github.com/apache/airflow/issues/15986 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] potiuk commented on issue #18950: Basic tutorial example has many bugs

2021-10-13 Thread GitBox
potiuk commented on issue #18950: URL: https://github.com/apache/airflow/issues/18950#issuecomment-942534056 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

[GitHub] [airflow] potiuk merged pull request #18947: Fix occassionally failing timeout test

2021-10-13 Thread GitBox
potiuk merged pull request #18947: URL: https://github.com/apache/airflow/pull/18947 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] github-actions[bot] commented on pull request #18955: Adds Pendulum 1.x -> 2.x upgrade documentation

2021-10-13 Thread GitBox
github-actions[bot] commented on pull request #18955: URL: https://github.com/apache/airflow/pull/18955#issuecomment-942578442 The PR is likely ready to be merged. No tests are needed as no important environment files, nor python files were modified by it. However, committers might decide

[GitHub] [airflow] zevaverbach commented on a change in pull request #18610: fixed default value of execution_timeout in base operator

2021-10-13 Thread GitBox
zevaverbach commented on a change in pull request #18610: URL: https://github.com/apache/airflow/pull/18610#discussion_r728310523 ## File path: airflow/models/baseoperator.py ## @@ -502,7 +502,7 @@ def __init__( pool: Optional[str] = None, pool_slots: int =

[GitHub] [airflow] zachliu edited a comment on issue #18894: Migrate from 2.1.4 to 2.2.0

2021-10-13 Thread GitBox
zachliu edited a comment on issue #18894: URL: https://github.com/apache/airflow/issues/18894#issuecomment-941630187 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

[GitHub] [airflow] hpatel-higi commented on issue #18846: Scheduler stops running: psycopg2.OperationalError: SSL SYSCALL error: EOF detected

2021-10-13 Thread GitBox
hpatel-higi commented on issue #18846: URL: https://github.com/apache/airflow/issues/18846#issuecomment-942485538 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

[GitHub] [airflow] potiuk commented on pull request #18949: Fix very rare test_fast_follow failure.

2021-10-13 Thread GitBox
potiuk commented on pull request #18949: URL: https://github.com/apache/airflow/pull/18949#issuecomment-942442912 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

[GitHub] [airflow] jedcunningham commented on issue #15986: Deleting a DagRun from UI does not delete its associated tasks

2021-10-13 Thread GitBox
jedcunningham commented on issue #15986: URL: https://github.com/apache/airflow/issues/15986#issuecomment-942423611 As of 2.2.0, deleting the DagRun does cascade delete the TIs. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [airflow] boring-cyborg[bot] commented on pull request #18955: Adds Pendulum 1.x -> 2.x upgrade documentation

2021-10-13 Thread GitBox
boring-cyborg[bot] commented on pull request #18955: URL: https://github.com/apache/airflow/pull/18955#issuecomment-942572010 Congratulations on your first Pull Request and welcome to the Apache Airflow community! If you have any issues or are unsure about any anything please check our

[GitHub] [airflow] MM-Lehmann commented on issue #18894: Migrate from 2.1.4 to 2.2.0

2021-10-13 Thread GitBox
MM-Lehmann commented on issue #18894: URL: https://github.com/apache/airflow/issues/18894#issuecomment-942464810 This becomes a bit neater with `... JOIN ... using (dag_id, execution_date)` > > Am

[GitHub] [airflow] SamWheating commented on a change in pull request #18944: Adding feature in bash operator to append the user defined env variable to system env variable

2021-10-13 Thread GitBox
SamWheating commented on a change in pull request #18944: URL: https://github.com/apache/airflow/pull/18944#discussion_r728274748 ## File path: airflow/operators/bash.py ## @@ -44,6 +44,11 @@ class BashOperator(BaseOperator): of inheriting the current process

[GitHub] [airflow] boring-cyborg[bot] commented on issue #18951: Airflow AWS default connection not accessible or null

2021-10-13 Thread GitBox
boring-cyborg[bot] commented on issue #18951: URL: https://github.com/apache/airflow/issues/18951#issuecomment-942450478 Thanks for opening your first issue here! Be sure to follow the issue template! -- This is an automated message from the Apache Git Service. To respond to the

  1   2   3   4   5   >