Re: [PR] Implement async version of databricks_conn in BaseDatabricksHook [airflow]

Mon, 23 Mar 2026 02:15:07 -0700 


mwojtyczka commented on PR #63611:
URL: https://github.com/apache/airflow/pull/63611#issuecomment-4109099201

   > I can't test all the different ways we would run it, but here is an 
example running airflow locally interacting with Databricks via SP & token
   > 
   > async (note the DEFERRAL) `[2026-03-18 12:00:03] INFO - Pausing task as 
DEFERRED. dag_id=test_async_databricks task_id=test_task 
run_id=manual__2026-03-18T16:59:59.189974+00:00` <img 
alt="{2D4E843C-3467-4BE0-A5C2-170F35C1C10B}" width="931" height="738" 
src="https://private-user-images.githubusercontent.com/19499860/565713120-c03fbd2f-b5f6-49bc-813a-4a6cdf5005b6.png?jwt=eyJ0eXAiOiJKV1QiLCJhbGciOiJIUzI1NiJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3NzQyNTc1NTMsIm5iZiI6MTc3NDI1NzI1MywicGF0aCI6Ii8xOTQ5OTg2MC81NjU3MTMxMjAtYzAzZmJkMmYtYjVmNi00OWJjLTgxM2EtNGE2Y2RmNTAwNWI2LnBuZz9YLUFtei1BbGdvcml0aG09QVdTNC1ITUFDLVNIQTI1NiZYLUFtei1DcmVkZW50aWFsPUFLSUFWQ09EWUxTQTUzUFFLNFpBJTJGMjAyNjAzMjMlMkZ1cy1lYXN0LTElMkZzMyUyRmF3czRfcmVxdWVzdCZYLUFtei1EYXRlPTIwMjYwMzIzVDA5MTQxM1omWC1BbXotRXhwaXJlcz0zMDAmWC1BbXotU2lnbmF0dXJlPTFhNDQwMjEwMWVjNGY1ZjZmNGMwMTgyNzFjNGQxMWFjMDRlNjNiMjM5NmU1NDExODljOWRkOWQxNDY0OTRlZGImWC1BbXotU2lnbmVkSGVhZGVycz1ob3N0In0.
 nM1kB7xIqsqh0VCWNcdEhycHMUJ6yfwP2mbRrUGuQY0">
   > 
   > sync <img alt="{FD49414A-F572-4944-9DA6-BEF5D4E39EB3}" width="899" 
height="738" 
src="https://private-user-images.githubusercontent.com/19499860/565713242-2e6580f1-a83c-4077-afa4-6acc973bc8c4.png?jwt=eyJ0eXAiOiJKV1QiLCJhbGciOiJIUzI1NiJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3NzQyNTc1NTMsIm5iZiI6MTc3NDI1NzI1MywicGF0aCI6Ii8xOTQ5OTg2MC81NjU3MTMyNDItMmU2NTgwZjEtYTgzYy00MDc3LWFmYTQtNmFjYzk3M2JjOGM0LnBuZz9YLUFtei1BbGdvcml0aG09QVdTNC1ITUFDLVNIQTI1NiZYLUFtei1DcmVkZW50aWFsPUFLSUFWQ09EWUxTQTUzUFFLNFpBJTJGMjAyNjAzMjMlMkZ1cy1lYXN0LTElMkZzMyUyRmF3czRfcmVxdWVzdCZYLUFtei1EYXRlPTIwMjYwMzIzVDA5MTQxM1omWC1BbXotRXhwaXJlcz0zMDAmWC1BbXotU2lnbmF0dXJlPWRiZTZlOTBiMWIxNzljYWZlNzczMWY0YWNiMzExMTQwYzFkMGVlZWFjMzhlMTBiMTk5MDhhNjI5ODE5Y2RkMTgmWC1BbXotU2lnbmVkSGVhZGVycz1ob3N0In0.IWXPKrqLHYdjFTbtVzuNpG1SGPIHQ9D0qc4X-fwWQB8";>
   > 
   > ```python
   > from __future__ import annotations
   > 
   > from datetime import datetime, timezone
   > 
   > from airflow import DAG
   > from airflow.providers.databricks.operators.databricks import 
DatabricksRunNowOperator
   > 
   > with DAG(
   >     dag_id="test_async_databricks",
   >     start_date=datetime(2024, 1, 1, tzinfo=timezone.utc),
   >     schedule=None,
   >     catchup=False,
   > ):
   >     DatabricksRunNowOperator(
   >         task_id="test_task",
   >         databricks_conn_id="databricks_default",
   >         deferrable=True, #False for sync
   >         job_name="[dev bob_skowron] Calendar regression tests",
   >     )
   > ```
   
   LGTM, thanks for testing!


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to