(airflow) branch constraints-main updated: Updating constraints. Github run id:6912456669

2023-11-17 Thread github-bot
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a commit to branch constraints-main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/constraints-main by this push: new 28bf9b0c42 Updating

Re: [I] DAG removed, but still visible in WebUI, cannot delete dag manually from UI 404 [airflow]

2023-11-17 Thread via GitHub
github-actions[bot] commented on issue #23890: URL: https://github.com/apache/airflow/issues/23890#issuecomment-1817417809 This issue has been automatically marked as stale because it has been open for 365 days without any activity. There has been several Airflow releases since last

(airflow) branch main updated: Align documentation of `MSSQLToGCSOperator` (#35715)

2023-11-17 Thread eladkal
This is an automated email from the ASF dual-hosted git repository. eladkal pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new ed6fe240c3 Align documentation of

Re: [PR] Align documentation of `MSSQLToGCSOperator` [airflow]

2023-11-17 Thread via GitHub
boring-cyborg[bot] commented on PR #35715: URL: https://github.com/apache/airflow/pull/35715#issuecomment-1817416982 Awesome work, congrats on your first merged pull request! You are invited to check our [Issue Tracker](https://github.com/apache/airflow/issues) for additional

Re: [I] Documentation Operator name diverges from real name [airflow]

2023-11-17 Thread via GitHub
eladkal closed issue #35705: Documentation Operator name diverges from real name URL: https://github.com/apache/airflow/issues/35705 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

Re: [PR] Align documentation of `MSSQLToGCSOperator` [airflow]

2023-11-17 Thread via GitHub
eladkal merged PR #35715: URL: https://github.com/apache/airflow/pull/35715 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

Re: [PR] confirmation dialog box for DAG run actions [airflow]

2023-11-17 Thread via GitHub
theaadya commented on code in PR #35393: URL: https://github.com/apache/airflow/pull/35393#discussion_r1398050320 ## airflow/www/static/js/dag/details/dagRun/ClearRun.tsx: ## @@ -59,31 +60,57 @@ const ClearRun = ({ runId, ...otherProps }: Props) => { onQueue({ confirmed:

Re: [I] Add EC2RebootInstanceOperator and EC2HibernateInstanceOperator to Amazon Provider [airflow]

2023-11-17 Thread via GitHub
dashton90 commented on issue #35703: URL: https://github.com/apache/airflow/issues/35703#issuecomment-1817342412 I'd be happy to take this one. Is it more sensible to add `hibernate` as a parameter to the `EC2StopInstanceOperator`, or create a separate `EC2HibernateInstanceOperator`? --

Re: [PR] Add multiselect to run state in grid view [airflow]

2023-11-17 Thread via GitHub
vchiapaikeo commented on PR #35403: URL: https://github.com/apache/airflow/pull/35403#issuecomment-1817331765 Great. Still need to do some work on tests but here's what I've got so far - https://github.com/apache/airflow/assets/9200263/8ead1753-06d0-479a-8b95-9db8cf1216b0 -- This

[PR] KubernetesPodTrigger: add stacktrace to trigger event message [airflow]

2023-11-17 Thread via GitHub
functicons opened a new pull request, #35716: URL: https://github.com/apache/airflow/pull/35716 Ref #34644 --- In deferrable mode, the current logs are not sufficient to debug issues happened in the trigger or hook, so adding stack trace and log the event in

Re: [PR] Fix 'scheme' and 'schema' handling in HttpHook [airflow]

2023-11-17 Thread via GitHub
Bisk1 commented on code in PR #35712: URL: https://github.com/apache/airflow/pull/35712#discussion_r1398011645 ## airflow/providers/apache/livy/hooks/livy.py: ## @@ -575,10 +575,11 @@ def _generate_base_url(self, conn: Connection) -> str: if conn.host and "://" in

Re: [PR] Fix 'scheme' and 'schema' handling in HttpHook [airflow]

2023-11-17 Thread via GitHub
Bisk1 commented on code in PR #35712: URL: https://github.com/apache/airflow/pull/35712#discussion_r1398011645 ## airflow/providers/apache/livy/hooks/livy.py: ## @@ -575,10 +575,11 @@ def _generate_base_url(self, conn: Connection) -> str: if conn.host and "://" in

Re: [PR] Fix 'scheme' and 'schema' handling in HttpHook [airflow]

2023-11-17 Thread via GitHub
Bisk1 commented on code in PR #35712: URL: https://github.com/apache/airflow/pull/35712#discussion_r1398011645 ## airflow/providers/apache/livy/hooks/livy.py: ## @@ -575,10 +575,11 @@ def _generate_base_url(self, conn: Connection) -> str: if conn.host and "://" in

Re: [PR] Fix 'scheme' and 'schema' handling in HttpHook [airflow]

2023-11-17 Thread via GitHub
Bisk1 commented on code in PR #35712: URL: https://github.com/apache/airflow/pull/35712#discussion_r1398008829 ## airflow/providers/apache/livy/hooks/livy.py: ## @@ -575,10 +575,11 @@ def _generate_base_url(self, conn: Connection) -> str: if conn.host and "://" in

Re: [PR] Fix 'scheme' and 'schema' handling in HttpHook [airflow]

2023-11-17 Thread via GitHub
Bisk1 commented on code in PR #35712: URL: https://github.com/apache/airflow/pull/35712#discussion_r1398011645 ## airflow/providers/apache/livy/hooks/livy.py: ## @@ -575,10 +575,11 @@ def _generate_base_url(self, conn: Connection) -> str: if conn.host and "://" in

Re: [PR] Fix 'scheme' and 'schema' handling in HttpHook [airflow]

2023-11-17 Thread via GitHub
Bisk1 commented on code in PR #35712: URL: https://github.com/apache/airflow/pull/35712#discussion_r1398011645 ## airflow/providers/apache/livy/hooks/livy.py: ## @@ -575,10 +575,11 @@ def _generate_base_url(self, conn: Connection) -> str: if conn.host and "://" in

Re: [PR] Fix 'scheme' and 'schema' handling in HttpHook [airflow]

2023-11-17 Thread via GitHub
Bisk1 commented on code in PR #35712: URL: https://github.com/apache/airflow/pull/35712#discussion_r1398011035 ## airflow/providers/apache/livy/hooks/livy.py: ## @@ -575,10 +575,11 @@ def _generate_base_url(self, conn: Connection) -> str: if conn.host and "://" in

Re: [PR] Fix 'scheme' and 'schema' handling in HttpHook [airflow]

2023-11-17 Thread via GitHub
Bisk1 commented on code in PR #35712: URL: https://github.com/apache/airflow/pull/35712#discussion_r1398008829 ## airflow/providers/apache/livy/hooks/livy.py: ## @@ -575,10 +575,11 @@ def _generate_base_url(self, conn: Connection) -> str: if conn.host and "://" in

Re: [PR] Fix 'scheme' and 'schema' handling in HttpHook [airflow]

2023-11-17 Thread via GitHub
Bisk1 commented on code in PR #35712: URL: https://github.com/apache/airflow/pull/35712#discussion_r1398008829 ## airflow/providers/apache/livy/hooks/livy.py: ## @@ -575,10 +575,11 @@ def _generate_base_url(self, conn: Connection) -> str: if conn.host and "://" in

Re: [PR] Fix 'scheme' and 'schema' handling in HttpHook [airflow]

2023-11-17 Thread via GitHub
Bisk1 commented on code in PR #35712: URL: https://github.com/apache/airflow/pull/35712#discussion_r1398008829 ## airflow/providers/apache/livy/hooks/livy.py: ## @@ -575,10 +575,11 @@ def _generate_base_url(self, conn: Connection) -> str: if conn.host and "://" in

Re: [PR] Fix 'scheme' and 'schema' handling in HttpHook [airflow]

2023-11-17 Thread via GitHub
Bisk1 commented on code in PR #35712: URL: https://github.com/apache/airflow/pull/35712#discussion_r1398008829 ## airflow/providers/apache/livy/hooks/livy.py: ## @@ -575,10 +575,11 @@ def _generate_base_url(self, conn: Connection) -> str: if conn.host and "://" in

Re: [PR] Fix 'scheme' and 'schema' handling in HttpHook [airflow]

2023-11-17 Thread via GitHub
Bisk1 commented on code in PR #35712: URL: https://github.com/apache/airflow/pull/35712#discussion_r1398008829 ## airflow/providers/apache/livy/hooks/livy.py: ## @@ -575,10 +575,11 @@ def _generate_base_url(self, conn: Connection) -> str: if conn.host and "://" in

Re: [PR] Fix 'scheme' and 'schema' handling in HttpHook [airflow]

2023-11-17 Thread via GitHub
Bisk1 commented on code in PR #35712: URL: https://github.com/apache/airflow/pull/35712#discussion_r1398008829 ## airflow/providers/apache/livy/hooks/livy.py: ## @@ -575,10 +575,11 @@ def _generate_base_url(self, conn: Connection) -> str: if conn.host and "://" in

Re: [PR] Fix 'scheme' and 'schema' handling in HttpHook [airflow]

2023-11-17 Thread via GitHub
Bisk1 commented on code in PR #35712: URL: https://github.com/apache/airflow/pull/35712#discussion_r1398008829 ## airflow/providers/apache/livy/hooks/livy.py: ## @@ -575,10 +575,11 @@ def _generate_base_url(self, conn: Connection) -> str: if conn.host and "://" in

Re: [PR] Fix 'scheme' and 'schema' handling in HttpHook [airflow]

2023-11-17 Thread via GitHub
Bisk1 commented on code in PR #35712: URL: https://github.com/apache/airflow/pull/35712#discussion_r1398008829 ## airflow/providers/apache/livy/hooks/livy.py: ## @@ -575,10 +575,11 @@ def _generate_base_url(self, conn: Connection) -> str: if conn.host and "://" in

Re: [PR] Fix 'scheme' and 'schema' handling in HttpHook [airflow]

2023-11-17 Thread via GitHub
Bisk1 commented on code in PR #35712: URL: https://github.com/apache/airflow/pull/35712#discussion_r1398008829 ## airflow/providers/apache/livy/hooks/livy.py: ## @@ -575,10 +575,11 @@ def _generate_base_url(self, conn: Connection) -> str: if conn.host and "://" in

Re: [PR] Add plugin folder to breeze env [airflow]

2023-11-17 Thread via GitHub
github-actions[bot] commented on PR #32117: URL: https://github.com/apache/airflow/pull/32117#issuecomment-1817275447 This pull request has been automatically marked as stale because it has not had recent activity. It will be closed in 5 days if no further activity occurs. Thank you for

Re: [PR] Improve precision of the remove_task_decorator function [airflow]

2023-11-17 Thread via GitHub
github-actions[bot] closed pull request #34509: Improve precision of the remove_task_decorator function URL: https://github.com/apache/airflow/pull/34509 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

Re: [PR] Refactor os.makedirs/os.mkdir to Path.mkdir [airflow]

2023-11-17 Thread via GitHub
github-actions[bot] closed pull request #34385: Refactor os.makedirs/os.mkdir to Path.mkdir URL: https://github.com/apache/airflow/pull/34385 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

Re: [I] Airflow-2.6.3 Mysql: Deadlock found when trying to get lock; try restarting transaction [airflow]

2023-11-17 Thread via GitHub
github-actions[bot] closed issue #35144: Airflow-2.6.3 Mysql: Deadlock found when trying to get lock; try restarting transaction URL: https://github.com/apache/airflow/issues/35144 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

Re: [PR] Warning when viewing docs for previous versions of Airflow [airflow]

2023-11-17 Thread via GitHub
github-actions[bot] commented on PR #34639: URL: https://github.com/apache/airflow/pull/34639#issuecomment-1817275382 This pull request has been automatically marked as stale because it has not had recent activity. It will be closed in 5 days if no further activity occurs. Thank you for

Re: [I] Airflow-2.6.3 Mysql: Deadlock found when trying to get lock; try restarting transaction [airflow]

2023-11-17 Thread via GitHub
github-actions[bot] commented on issue #35144: URL: https://github.com/apache/airflow/issues/35144#issuecomment-1817275359 This issue has been closed because it has not received response from the issue author. -- This is an automated message from the Apache Git Service. To respond to the

Re: [I] ComputeEngineSSHHook unintentionally deletes instance metadata [airflow]

2023-11-17 Thread via GitHub
github-actions[bot] commented on issue #35171: URL: https://github.com/apache/airflow/issues/35171#issuecomment-1817275328 This issue has been automatically marked as stale because it has been open for 14 days with no response from the author. It will be closed in next 7 days if no further

Re: [I] Documentation Operator name diverges from real name [airflow]

2023-11-17 Thread via GitHub
hguercan commented on issue #35705: URL: https://github.com/apache/airflow/issues/35705#issuecomment-1817274157 https://github.com/apache/airflow/pull/35715 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[PR] align documentation to state correct operator name [airflow]

2023-11-17 Thread via GitHub
hguercan opened a new pull request, #35715: URL: https://github.com/apache/airflow/pull/35715 --- **^ Add meaningful description above** Read the **[Pull Request

Re: [PR] align documentation to state correct operator name [airflow]

2023-11-17 Thread via GitHub
boring-cyborg[bot] commented on PR #35715: URL: https://github.com/apache/airflow/pull/35715#issuecomment-1817273924 Congratulations on your first Pull Request and welcome to the Apache Airflow community! If you have any issues or are unsure about any anything please check our Contribution

(airflow) branch constraints-main updated: Updating constraints. Github run id:6909922976

2023-11-17 Thread github-bot
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a commit to branch constraints-main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/constraints-main by this push: new 9f1a97c3a2 Updating

Re: [PR] Fix parsing connection uri which contains a composite protocol sparated by : [airflow]

2023-11-17 Thread via GitHub
dstandish commented on PR #33531: URL: https://github.com/apache/airflow/pull/33531#issuecomment-1817229507 This fix may not be necessary: see comment https://github.com/apache/airflow/issues/33442#issuecomment-1817228790 -- This is an automated message from the Apache Git

Re: [I] JDBC url parsing exception [airflow]

2023-11-17 Thread via GitHub
dstandish commented on issue #33442: URL: https://github.com/apache/airflow/issues/33442#issuecomment-1817228790 For this problem, what are the actual connection attrs we are trying to encode? For example, this code produces no errors: ``` from airflow.models.connection import

Re: [I] Documentation Operator name diverges from real name [airflow]

2023-11-17 Thread via GitHub
hguercan commented on issue #35705: URL: https://github.com/apache/airflow/issues/35705#issuecomment-1817226109 Can it be assigned to me as my first task please? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

(airflow) branch main updated: Add Azure Synapse Pipeline connection-type in the UI (#35709)

2023-11-17 Thread taragolis
This is an automated email from the ASF dual-hosted git repository. taragolis pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new 429ca47b02 Add Azure Synapse Pipeline

Re: [PR] Update provider.yaml: To view Azure Synapse Pipeline Connection type in Airflow UI [airflow]

2023-11-17 Thread via GitHub
Taragolis merged PR #35709: URL: https://github.com/apache/airflow/pull/35709 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

Re: [I] JDBC url parsing exception [airflow]

2023-11-17 Thread via GitHub
dstandish commented on issue #33442: URL: https://github.com/apache/airflow/issues/33442#issuecomment-1817223331 It appears this is a conflation of JDBC URI vs Airflow Connection URI It's perfectly valid for airflow to require that its connections be encoded with `://` But

Re: [PR] Fix 'scheme' and 'schema' handling in HttpHook [airflow]

2023-11-17 Thread via GitHub
Taragolis commented on code in PR #35712: URL: https://github.com/apache/airflow/pull/35712#discussion_r1397953807 ## airflow/providers/apache/livy/hooks/livy.py: ## @@ -575,10 +575,11 @@ def _generate_base_url(self, conn: Connection) -> str: if conn.host and "://" in

Re: [PR] Fix 'scheme' and 'schema' handling in HttpHook [airflow]

2023-11-17 Thread via GitHub
Bisk1 commented on code in PR #35712: URL: https://github.com/apache/airflow/pull/35712#discussion_r1397943452 ## airflow/providers/apache/livy/hooks/livy.py: ## @@ -575,10 +575,11 @@ def _generate_base_url(self, conn: Connection) -> str: if conn.host and "://" in

Re: [PR] Fix 'scheme' and 'schema' handling in HttpHook [airflow]

2023-11-17 Thread via GitHub
Bisk1 commented on code in PR #35712: URL: https://github.com/apache/airflow/pull/35712#discussion_r1397943452 ## airflow/providers/apache/livy/hooks/livy.py: ## @@ -575,10 +575,11 @@ def _generate_base_url(self, conn: Connection) -> str: if conn.host and "://" in

Re: [PR] Fix 'scheme' and 'schema' handling in HttpHook [airflow]

2023-11-17 Thread via GitHub
Bisk1 commented on code in PR #35712: URL: https://github.com/apache/airflow/pull/35712#discussion_r1397943452 ## airflow/providers/apache/livy/hooks/livy.py: ## @@ -575,10 +575,11 @@ def _generate_base_url(self, conn: Connection) -> str: if conn.host and "://" in

Re: [PR] Fix 'scheme' and 'schema' handling in HttpHook [airflow]

2023-11-17 Thread via GitHub
Bisk1 commented on code in PR #35712: URL: https://github.com/apache/airflow/pull/35712#discussion_r1397943452 ## airflow/providers/apache/livy/hooks/livy.py: ## @@ -575,10 +575,11 @@ def _generate_base_url(self, conn: Connection) -> str: if conn.host and "://" in

Re: [PR] Fix 'scheme' and 'schema' handling in HttpHook [airflow]

2023-11-17 Thread via GitHub
Bisk1 commented on code in PR #35712: URL: https://github.com/apache/airflow/pull/35712#discussion_r1397943452 ## airflow/providers/apache/livy/hooks/livy.py: ## @@ -575,10 +575,11 @@ def _generate_base_url(self, conn: Connection) -> str: if conn.host and "://" in

Re: [PR] Fix 'scheme' and 'schema' handling in HttpHook [airflow]

2023-11-17 Thread via GitHub
Bisk1 commented on code in PR #35712: URL: https://github.com/apache/airflow/pull/35712#discussion_r1397943452 ## airflow/providers/apache/livy/hooks/livy.py: ## @@ -575,10 +575,11 @@ def _generate_base_url(self, conn: Connection) -> str: if conn.host and "://" in

Re: [PR] Fix 'scheme' and 'schema' handling in HttpHook [airflow]

2023-11-17 Thread via GitHub
Bisk1 commented on code in PR #35712: URL: https://github.com/apache/airflow/pull/35712#discussion_r1397943452 ## airflow/providers/apache/livy/hooks/livy.py: ## @@ -575,10 +575,11 @@ def _generate_base_url(self, conn: Connection) -> str: if conn.host and "://" in

Re: [PR] confirmation dialog box for DAG run actions [airflow]

2023-11-17 Thread via GitHub
bbovenzi commented on code in PR #35393: URL: https://github.com/apache/airflow/pull/35393#discussion_r1397937250 ## airflow/www/static/js/dag/details/dagRun/ClearRun.tsx: ## @@ -59,31 +60,57 @@ const ClearRun = ({ runId, ...otherProps }: Props) => { onQueue({ confirmed:

Re: [PR] Fix 'scheme' and 'schema' handling in HttpHook [airflow]

2023-11-17 Thread via GitHub
Taragolis commented on code in PR #35712: URL: https://github.com/apache/airflow/pull/35712#discussion_r1397922146 ## airflow/providers/apache/livy/hooks/livy.py: ## @@ -575,10 +575,11 @@ def _generate_base_url(self, conn: Connection) -> str: if conn.host and "://" in

Re: [PR] Fix 'scheme' and 'schema' handling in HttpHook [airflow]

2023-11-17 Thread via GitHub
Bisk1 commented on code in PR #35712: URL: https://github.com/apache/airflow/pull/35712#discussion_r1397916362 ## airflow/providers/apache/livy/hooks/livy.py: ## @@ -575,10 +575,11 @@ def _generate_base_url(self, conn: Connection) -> str: if conn.host and "://" in

Re: [PR] Fix 'scheme' and 'schema' handling in HttpHook [airflow]

2023-11-17 Thread via GitHub
Bisk1 commented on code in PR #35712: URL: https://github.com/apache/airflow/pull/35712#discussion_r1397916362 ## airflow/providers/apache/livy/hooks/livy.py: ## @@ -575,10 +575,11 @@ def _generate_base_url(self, conn: Connection) -> str: if conn.host and "://" in

Re: [PR] Fix 'scheme' and 'schema' handling in HttpHook [airflow]

2023-11-17 Thread via GitHub
Bisk1 commented on code in PR #35712: URL: https://github.com/apache/airflow/pull/35712#discussion_r1397916362 ## airflow/providers/apache/livy/hooks/livy.py: ## @@ -575,10 +575,11 @@ def _generate_base_url(self, conn: Connection) -> str: if conn.host and "://" in

Re: [PR] Implement login and logout in AWS auth manager [airflow]

2023-11-17 Thread via GitHub
vincbeck commented on code in PR #35488: URL: https://github.com/apache/airflow/pull/35488#discussion_r1397913840 ## airflow/providers/amazon/provider.yaml: ## @@ -91,6 +91,7 @@ dependencies: - redshift_connector>=2.0.888 - sqlalchemy_redshift>=0.8.6 - asgiref + -

Re: [PR] Allow a wider range of watchtower versions [airflow]

2023-11-17 Thread via GitHub
o-nikolas commented on PR #35713: URL: https://github.com/apache/airflow/pull/35713#issuecomment-1817139400 > Is the added config of `cloudwatch_task_handler_json_serializer` relevant for watchtower<3 ? If not we should also edit the description of the setting with note about it to avoid

Re: [PR] Fix 'scheme' and 'schema' handling in HttpHook [airflow]

2023-11-17 Thread via GitHub
Taragolis commented on code in PR #35712: URL: https://github.com/apache/airflow/pull/35712#discussion_r1397908444 ## airflow/providers/apache/livy/hooks/livy.py: ## @@ -575,10 +575,11 @@ def _generate_base_url(self, conn: Connection) -> str: if conn.host and "://" in

Re: [PR] Add extra operator links for EMR Serverless [airflow]

2023-11-17 Thread via GitHub
dacort commented on code in PR #34225: URL: https://github.com/apache/airflow/pull/34225#discussion_r1397908394 ## tests/providers/amazon/aws/operators/test_emr_serverless.py: ## Review Comment: Yea, adding some tests for the branching logic would be nice. It gets a

Re: [PR] Add extra operator links for EMR Serverless [airflow]

2023-11-17 Thread via GitHub
dacort commented on code in PR #34225: URL: https://github.com/apache/airflow/pull/34225#discussion_r1397907473 ## airflow/providers/amazon/aws/links/emr.py: ## @@ -66,3 +82,98 @@ def get_log_uri( return None log_uri = S3Hook.parse_s3_url(cluster_info["LogUri"])

(airflow) branch main updated: Update http to s3 system test (#35711)

2023-11-17 Thread onikolas
This is an automated email from the ASF dual-hosted git repository. onikolas pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new 09fef3c3ee Update http to s3 system test

Re: [PR] Update http to s3 system test [airflow]

2023-11-17 Thread via GitHub
o-nikolas merged PR #35711: URL: https://github.com/apache/airflow/pull/35711 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

(airflow) branch constraints-main updated: Updating constraints. Github run id:6908803280

2023-11-17 Thread github-bot
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a commit to branch constraints-main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/constraints-main by this push: new 4d48ad7d3a Updating

Re: [PR] Fix 'scheme' and 'schema' handling in HttpHook [airflow]

2023-11-17 Thread via GitHub
Bisk1 commented on PR #35712: URL: https://github.com/apache/airflow/pull/35712#issuecomment-1817118275 @Taragolis ok, I am not trying to change Airflow URI into any of those. But shouldn't Airflow URI format adhere to generic syntax of all URIs as defined by RFC 3986? -- This is an

[PR] [WIP] Create a generic callbacks class for KubernetesPodOperator [airflow]

2023-11-17 Thread via GitHub
hussein-awala opened a new pull request, #35714: URL: https://github.com/apache/airflow/pull/35714 (no comment) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

(airflow) branch main updated: Long custom operator name overflows in graph view (#35382)

2023-11-17 Thread bbovenzi
This is an automated email from the ASF dual-hosted git repository. bbovenzi pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new 4d872b87ef Long custom operator name overflows

Re: [PR] Long custom operator name overflows in graph view [airflow]

2023-11-17 Thread via GitHub
bbovenzi merged PR #35382: URL: https://github.com/apache/airflow/pull/35382 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

Re: [I] Long custom operator name overflows in graph view [airflow]

2023-11-17 Thread via GitHub
bbovenzi closed issue #33693: Long custom operator name overflows in graph view URL: https://github.com/apache/airflow/issues/33693 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

Re: [PR] Extend task context logging support for remote logging using Elasticsearch [airflow]

2023-11-17 Thread via GitHub
pankajkoti commented on code in PR #32977: URL: https://github.com/apache/airflow/pull/32977#discussion_r1397845450 ## airflow/providers/elasticsearch/log/es_task_handler.py: ## @@ -84,6 +85,32 @@ def get_es_kwargs_from_config() -> dict[str, Any]: return kwargs_dict

Re: [PR] Extend task context logging support for remote logging using Elasticsearch [airflow]

2023-11-17 Thread via GitHub
pankajkoti commented on code in PR #32977: URL: https://github.com/apache/airflow/pull/32977#discussion_r1397845450 ## airflow/providers/elasticsearch/log/es_task_handler.py: ## @@ -84,6 +85,32 @@ def get_es_kwargs_from_config() -> dict[str, Any]: return kwargs_dict

Re: [PR] Allow a wider range of watchtower versions [airflow]

2023-11-17 Thread via GitHub
eladkal commented on PR #35713: URL: https://github.com/apache/airflow/pull/35713#issuecomment-1817041519 Is the added setting of `cloudwatch_task_handler_json_serializer` relevant for watchtower<3 ? If not we should also edit the description of the setting with note about it to avoid

[PR] Allow a wider range of watchtower versions [airflow]

2023-11-17 Thread via GitHub
o-nikolas opened a new pull request, #35713: URL: https://github.com/apache/airflow/pull/35713 #34747 upgraded the Amazon Provider Package to support Watchtower V3. The requirements were updated to only install v3 versions of watchtower, but many users may still need to use V2 (see example

Re: [PR] Implement login and logout in AWS auth manager [airflow]

2023-11-17 Thread via GitHub
eladkal commented on code in PR #35488: URL: https://github.com/apache/airflow/pull/35488#discussion_r1397834145 ## airflow/providers/amazon/provider.yaml: ## @@ -91,6 +91,7 @@ dependencies: - redshift_connector>=2.0.888 - sqlalchemy_redshift>=0.8.6 - asgiref + -

Re: [PR] Long custom operator name overflows in graph view [airflow]

2023-11-17 Thread via GitHub
ivan-afonichkin commented on PR #35382: URL: https://github.com/apache/airflow/pull/35382#issuecomment-1817036055 @Taragolis do you know if I need to get anyone else approval or someone can merge it? -- This is an automated message from the Apache Git Service. To respond to the message,

Re: [PR] Implement login and logout in AWS auth manager [airflow]

2023-11-17 Thread via GitHub
eladkal commented on code in PR #35488: URL: https://github.com/apache/airflow/pull/35488#discussion_r1397834145 ## airflow/providers/amazon/provider.yaml: ## @@ -91,6 +91,7 @@ dependencies: - redshift_connector>=2.0.888 - sqlalchemy_redshift>=0.8.6 - asgiref + -

Re: [PR] Extend task context logging support for remote logging using Elasticsearch [airflow]

2023-11-17 Thread via GitHub
dstandish commented on code in PR #32977: URL: https://github.com/apache/airflow/pull/32977#discussion_r1397820932 ## airflow/providers/elasticsearch/log/es_task_handler.py: ## @@ -84,6 +85,32 @@ def get_es_kwargs_from_config() -> dict[str, Any]: return kwargs_dict

Re: [PR] Extend task context logging support for remote logging using Elasticsearch [airflow]

2023-11-17 Thread via GitHub
dstandish commented on code in PR #32977: URL: https://github.com/apache/airflow/pull/32977#discussion_r1397801715 ## airflow/providers/elasticsearch/log/es_task_handler.py: ## @@ -182,8 +183,14 @@ def format_url(host: str) -> str: return host -def

Re: [I] Celery worker enters a catatonic state after redis restart [airflow]

2023-11-17 Thread via GitHub
RNHTTR commented on issue #26542: URL: https://github.com/apache/airflow/issues/26542#issuecomment-1816984824 > Yes. You need to run similar monitoring and restarting of Celery on your own. Liveness Probe runs periodicaly check if any component is responding and will restart it when it is

Re: [PR] Implement login and logout in AWS auth manager [airflow]

2023-11-17 Thread via GitHub
vincbeck commented on code in PR #35488: URL: https://github.com/apache/airflow/pull/35488#discussion_r1397787681 ## airflow/providers/amazon/provider.yaml: ## @@ -91,6 +91,7 @@ dependencies: - redshift_connector>=2.0.888 - sqlalchemy_redshift>=0.8.6 - asgiref + -

Re: [I] HTTP connection parse path as schema but use as protocol [airflow]

2023-11-17 Thread via GitHub
Bisk1 commented on issue #10913: URL: https://github.com/apache/airflow/issues/10913#issuecomment-1816979906 Ok, after looking into this issue again I see that parts of my comment were mistaken - I realised that 'schema' in connection is not 'scheme' with a typo but a database schema. This

Re: [PR] Extend task context logging support for remote logging using Elasticsearch [airflow]

2023-11-17 Thread via GitHub
pankajkoti commented on code in PR #32977: URL: https://github.com/apache/airflow/pull/32977#discussion_r1397782966 ## airflow/providers/elasticsearch/log/es_task_handler.py: ## @@ -182,8 +183,14 @@ def format_url(host: str) -> str: return host -def

Re: [PR] Fix 'scheme' and 'schema' handling in HttpHook [airflow]

2023-11-17 Thread via GitHub
Bisk1 commented on PR #35712: URL: https://github.com/apache/airflow/pull/35712#issuecomment-1816973159 This PR should fix the issue, but I wonder what should be done about connections that were created in the past using existing behaviour as a workaround. E.g. https://example.com was

Re: [PR] Extend task context logging support for remote logging using Elasticsearch [airflow]

2023-11-17 Thread via GitHub
eladkal commented on PR #32977: URL: https://github.com/apache/airflow/pull/32977#issuecomment-1816968595 static checks fails -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

Re: [PR] Implement login and logout in AWS auth manager [airflow]

2023-11-17 Thread via GitHub
eladkal commented on code in PR #35488: URL: https://github.com/apache/airflow/pull/35488#discussion_r1397776679 ## airflow/providers/amazon/provider.yaml: ## @@ -91,6 +91,7 @@ dependencies: - redshift_connector>=2.0.888 - sqlalchemy_redshift>=0.8.6 - asgiref + -

[PR] Fix 'scheme' and 'schema' handling in HttpHook [airflow]

2023-11-17 Thread via GitHub
Bisk1 opened a new pull request, #35712: URL: https://github.com/apache/airflow/pull/35712 Fixes #10913 Previously, when building a connection string in HttpHook.get_conn, conn.schema was used as URL scheme, but it should be URL path. Now conn.conn_type ('http' or 'https') is used

Re: [PR] Implement login and logout in AWS auth manager [airflow]

2023-11-17 Thread via GitHub
vincbeck commented on code in PR #35488: URL: https://github.com/apache/airflow/pull/35488#discussion_r1397771183 ## airflow/providers/amazon/aws/auth_manager/aws_auth_manager.py: ## @@ -0,0 +1,145 @@ +# Licensed to the Apache Software Foundation (ASF) under one +# or more

Re: [PR] Implement login and logout in AWS auth manager [airflow]

2023-11-17 Thread via GitHub
vincbeck commented on code in PR #35488: URL: https://github.com/apache/airflow/pull/35488#discussion_r1397771183 ## airflow/providers/amazon/aws/auth_manager/aws_auth_manager.py: ## @@ -0,0 +1,145 @@ +# Licensed to the Apache Software Foundation (ASF) under one +# or more

Re: [PR] Implement login and logout in AWS auth manager [airflow]

2023-11-17 Thread via GitHub
vincbeck commented on code in PR #35488: URL: https://github.com/apache/airflow/pull/35488#discussion_r1397768910 ## airflow/providers/amazon/provider.yaml: ## @@ -91,6 +91,7 @@ dependencies: - redshift_connector>=2.0.888 - sqlalchemy_redshift>=0.8.6 - asgiref + -

Re: [PR] Implement login and logout in AWS auth manager [airflow]

2023-11-17 Thread via GitHub
o-nikolas commented on code in PR #35488: URL: https://github.com/apache/airflow/pull/35488#discussion_r1397768377 ## airflow/providers/amazon/aws/auth_manager/aws_auth_manager.py: ## @@ -0,0 +1,145 @@ +# Licensed to the Apache Software Foundation (ASF) under one +# or more

Re: [PR] Implement login and logout in AWS auth manager [airflow]

2023-11-17 Thread via GitHub
vincbeck commented on code in PR #35488: URL: https://github.com/apache/airflow/pull/35488#discussion_r1397767536 ## airflow/providers/amazon/aws/auth_manager/views/auth.py: ## @@ -0,0 +1,132 @@ +# Licensed to the Apache Software Foundation (ASF) under one +# or more

Re: [PR] Update http to s3 system test [airflow]

2023-11-17 Thread via GitHub
o-nikolas commented on PR #35711: URL: https://github.com/apache/airflow/pull/35711#issuecomment-1816954284 CC @vincbeck @syedahsn -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[PR] Update http to s3 system test [airflow]

2023-11-17 Thread via GitHub
o-nikolas opened a new pull request, #35711: URL: https://github.com/apache/airflow/pull/35711 Previously the system test was not functional because it did not start or connect to a real http test to copy the file from, which does not work for a system level test. This commit starts a

Re: [PR] Implement login and logout in AWS auth manager [airflow]

2023-11-17 Thread via GitHub
vincbeck commented on code in PR #35488: URL: https://github.com/apache/airflow/pull/35488#discussion_r1397764045 ## airflow/providers/amazon/aws/auth_manager/aws_auth_manager.py: ## @@ -0,0 +1,145 @@ +# Licensed to the Apache Software Foundation (ASF) under one +# or more

Re: [I] K8S Spark Operator doesn't delete an older application with the same name anymore [airflow]

2023-11-17 Thread via GitHub
eladkal commented on issue #32363: URL: https://github.com/apache/airflow/issues/32363#issuecomment-1816945122 if so then @blcksrx can you clarify what is the task on this issue? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to

Re: [I] Invalid kube-config file. Expected key current-context in kube-config when using deferrable=True [airflow]

2023-11-17 Thread via GitHub
functicons commented on issue #34644: URL: https://github.com/apache/airflow/issues/34644#issuecomment-1816937672 I feel like the error messages and logs need to be improved. The current ones are not sufficient to figure out what went wrong in the trigger/hook. -- This is an automated

Re: [PR] confirmation dialog box for DAG run actions [airflow]

2023-11-17 Thread via GitHub
bbovenzi commented on code in PR #35393: URL: https://github.com/apache/airflow/pull/35393#discussion_r1397742751 ## airflow/www/static/js/dag/details/dagRun/ActionModal.tsx: ## @@ -0,0 +1,100 @@ +/*! + * Licensed to the Apache Software Foundation (ASF) under one + * or more

Re: [PR] Implement login and logout in AWS auth manager [airflow]

2023-11-17 Thread via GitHub
o-nikolas commented on code in PR #35488: URL: https://github.com/apache/airflow/pull/35488#discussion_r1397740330 ## airflow/providers/amazon/aws/auth_manager/views/auth.py: ## @@ -0,0 +1,132 @@ +# Licensed to the Apache Software Foundation (ASF) under one +# or more

Re: [PR] Implement login and logout in AWS auth manager [airflow]

2023-11-17 Thread via GitHub
o-nikolas commented on code in PR #35488: URL: https://github.com/apache/airflow/pull/35488#discussion_r1397738543 ## airflow/providers/amazon/aws/auth_manager/aws_auth_manager.py: ## @@ -0,0 +1,145 @@ +# Licensed to the Apache Software Foundation (ASF) under one +# or more

[PR] Fix `--additional-extras` parameter in Breeze command [airflow]

2023-11-17 Thread via GitHub
vincbeck opened a new pull request, #35710: URL: https://github.com/apache/airflow/pull/35710 The parameter `--additional-extras` does not work in `breeze` under the `build` command. Example. `breeze ci-image build --python 3.8 --additional-extras "python3-saml"` ```

  1   2   3   >