GitHub user potiuk added a comment to the discussion: Using DatabricksSubmitRunOperator inside @task — is pool applied correctly
You are not supposed to run operator in `@task` decorated methods - this is a bad pattern than should not be used. You can call hooks inside the tasks - but calling operators in `@task` decorated methods is just a calling "execute" method of the operator, without applying any semantics of operator. I belive in modern airflow versions you get a warning when you do that. GitHub link: https://github.com/apache/airflow/discussions/62403#discussioncomment-15914084 ---- This is an automatically sent email for [email protected]. To unsubscribe, please send an email to: [email protected]
