NealSun96 opened a new issue #1506: URL: https://github.com/apache/helix/issues/1506
### Describe the bug After IdealState Removal for TaskFramework, we observe onDemand rebalance flooding. We traced back to a root cause: if a jobConfigs exists for a workflow that does not contain it in the DAG, the jobConfig will trigger runtimeJobDag refreshes every time a pipeline runs. Every time runtimeJobDag gets refreshed, it will re-process all the jobs that have been completed, and initiate a clean up process; such a process triggers an onDemand rebalance. ### To Reproduce Create a jobConfig for a workflow without adding it to the DAG. ### Expected behavior onDemand rebalances only happen when necessary. ### Additional context Add any other context about the problem here. ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
