GitHub user mengw15 edited a discussion: Proposal: Add Separate Driver 
Container in the Computing-Unit Pod and Route All UDFs There

## Summary

Currently, a computing unit is a single Pod with one Container running the 
Amber Coordinator (master). We propose adding a separate Container in the same 
Pod that runs an Amber Driver (worker). Operator scheduling will be updated so 
all UDF operators execute on the Driver container.

## Motivation

This design leverages Akka’s distribution features 

## Design (high level)

Separate Driver Container in the same Pod
Extend the Pod spec to start one new container for an Amber Driver.

Scheduling change
Update the scheduler so that all UDF operators are placed on the Driver 
container.
Non-UDF operators keep current placement (initially unchanged).

![WechatIMG128](https://github.com/user-attachments/assets/2255c36e-f897-45c1-9fda-6c6644ce12cf)


GitHub link: https://github.com/apache/texera/discussions/4021

----
This is an automatically sent email for [email protected].
To unsubscribe, please send an email to: 
[email protected]

Reply via email to