jscheffl commented on code in PR #48528:
URL: https://github.com/apache/airflow/pull/48528#discussion_r2021553920
##########
airflow-core/src/airflow/cli/commands/standalone_command.py:
##########
@@ -174,12 +174,8 @@ def calculate_env(self):
# Make sure we're using a local executor flavour
executor_class, _ = ExecutorLoader.import_default_executor_cls()
if not executor_class.is_local:
- if "sqlite" in conf.get("database", "sql_alchemy_conn"):
- self.print_output("standalone", "Forcing executor to
SequentialExecutor")
- env["AIRFLOW__CORE__EXECUTOR"] =
executor_constants.SEQUENTIAL_EXECUTOR
- else:
- self.print_output("standalone", "Forcing executor to
LocalExecutor")
- env["AIRFLOW__CORE__EXECUTOR"] =
executor_constants.LOCAL_EXECUTOR
+ self.print_output("standalone", "Forcing executor to
LocalExecutor")
+ env["AIRFLOW__CORE__EXECUTOR"] = executor_constants.LOCAL_EXECUTOR
Review Comment:
No, with current setup and TaskSDK there is no problem with parallelism
anymore. Tested locally (LocalExecutor with SQLite) and was running very well.
Especially also because nowadays SQLite allows concurrent access via a lock
file which was not possible in the past.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
