min-guk opened a new pull request, #2175: URL: https://github.com/apache/systemds/pull/2175
## Implementation Summary - Added functionality to detect conflicts in **OptimalFedPlan**, where specific **FedPlans (Hops)** have different **FedOutputTypes**. - The **OptimalFedPlan** is traversed from top to bottom using a **BFS** approach to detect conflicts. - Conflicts are resolved locally, even when one child has multiple parents, with **network costs** calculated only once. ## Limitations The current implementation has the following limitations: 1. It cannot guarantee either an **optimal cost plan** or a **suboptimal plan**. 2. Changes to the **local cost** affect all nodes up to the root, but these nodes are **not updated**. 3. **OptimalFedPlan** must be **traversed again** to search for conflicts. While this approach works, exploring better solutions to address these issues would be valuable. ## Questions 1. Is it acceptable for the **compute cost** and **memory access cost** calculations for **Federated Workers** and the **Local Coordinator** to remain the same? 2. Could you provide more specific examples of scenarios where our **OptimalFedPlan** calculations are effective or where conflicts occur? ## Future Work 1. Develop **test code workloads** to simulate scenarios where conflicts arise. 2. Write and validate **test code in a federated environment**. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: dev-unsubscr...@systemds.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
