L. C. Hsieh created SPARK-59021:
-----------------------------------
Summary: Import scg-store-memory and scg-pool-static crates into
Spark Connect Gateway
Key: SPARK-59021
URL: https://issues.apache.org/jira/browse/SPARK-59021
Project: Spark
Issue Type: Sub-task
Components: Connect
Affects Versions: connect-gateway-0.1.0
Reporter: L. C. Hsieh
Assignee: L. C. Hsieh
Part of importing the Spark Connect Gateway reference implementation into
apache/spark-connect-gateway as a series of small, bottom-up PRs.
This adds two small crates that implement the routing traits, grouped into one
PR:
- scg-store-memory — an in-process AffinityStore for single-replica
deployments
and tests (for multi-replica HA, scg-store-redis, added in a later PR, is
used instead).
- scg-pool-static — a backend Pool whose membership is fixed at startup (the
dynamic K8s-Endpoints-watch variant scg-pool-k8s comes in a later PR).
Both depend on the scg-routing crate (SPARK-58773) whose traits they implement.
They compile and test on their own (2 unit tests each) and are appended to the
workspace members list. They are consumed later by the proxy crate (both are
proxy dev-dependencies used by its tests).
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
