[ https://issues.apache.org/jira/browse/YARN-7834?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16621876#comment-16621876 ]
Gergely Pollak edited comment on YARN-7834 at 9/20/18 11:46 AM: ---------------------------------------------------------------- [~curino] thank you for the patch, I'm aware this might need some more work to be trunk compatible so I was unable to review it properly, but I've noticed that in the TestLPQueueRebalancerRandomize test suite non-seeded random is being used(on line 86), which mike result in transient errors without any way to reproduce them based on the test. I would suggest using seeded random in order to get more consistent results. was (Author: shuzirra): [~curino] thank you for the patch, while I'm aware this might need some more work to be trunk compatible so I was unable to review it properly, but I've noticed that in the TestLPQueueRebalancerRandomize test suite non-seeded random is being used(on line 86), which mike result in transient errors without any way to reproduce them based on the test. I would suggest using seeded random in order to get more consistent results. > [GQ] Rebalance queue configuration for load-balancing and locality affinities > ----------------------------------------------------------------------------- > > Key: YARN-7834 > URL: https://issues.apache.org/jira/browse/YARN-7834 > Project: Hadoop YARN > Issue Type: Sub-task > Reporter: Carlo Curino > Assignee: Carlo Curino > Priority: Major > Attachments: YARN-7834.v1.patch > > > This Jira tracks algorithmic work, which will run in the GPG and will > rebalance the mapping of queues to sub-clusters. The current design supports > both balancing the "load" across sub-clusters (proportionally to their size) > and as a second objective to maximize the affinity between queues and the > sub-clusters where they historically have most demand. -- This message was sent by Atlassian JIRA (v7.6.3#76005) --------------------------------------------------------------------- To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org