villebro commented on issue #2349:
URL:
https://github.com/apache/datafusion-ballista/issues/2349#issuecomment-5643330380
Thanks @phillipleblanc for getting this work started. I think this lists the
necessary prerequisites, but once the public APIs are in place, I’d love to see
a follow-up epic/milestone where Ballista itself ships support for one or more
commonly useful shared-state backends. I think if we only enable external
crates to implement active-passive failover, HA may still be too hard for
casual operators to actually adopt. For enterprise evaluation especially, it
would be much nicer if the stock scheduler binary could run in HA mode from
config/CLI, without requiring a fork or custom scheduler wrapper.
Just as an example, something like:
```shell
ballista-scheduler \
--scheduler-ha-enabled \
--scheduler-state-backend redis://...
```
or equivalent config-file settings.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]