GitHub user mengw15 edited a discussion: Proposal: Add Separate Amber Worker Container in the Computing-Unit Pod and Route All UDFs There
## Summary Currently, a computing unit is a single Pod with one Container running the Amber Coordinator (master). We propose adding a separate Container in the same Pod that runs an Amber worker. Operator scheduling will be updated so all UDF operators execute on the Worker container. ## Motivation This design leverages Akka’s distribution features ## Design (high level) Separate Worker Container in the same Pod Extend the Pod spec to start one new container for an Amber Worker. Scheduling change Update the scheduler so that all UDF operators are placed on the Worker container. Non-UDF operators keep current placement (initially unchanged). <img width="4555" height="3380" alt="computing-unit-pod-proposal drawio" src="https://github.com/user-attachments/assets/9475c647-4c46-4a0c-9f97-081c3f501c9e"; /> GitHub link: https://github.com/apache/texera/discussions/4021 ---- This is an automatically sent email for [email protected]. To unsubscribe, please send an email to: [email protected]
