Eric Payne created YARN-9894: -------------------------------- Summary: CapacitySchedulerPerf test for measuring hundreds of apps in a large number of queues. Key: YARN-9894 URL: https://issues.apache.org/jira/browse/YARN-9894 Project: Hadoop YARN Issue Type: Improvement Components: capacity scheduler, test Affects Versions: 3.1.3, 3.2.1, 2.8.5, 2.9.2 Reporter: Eric Payne
I have developed a unit test based on the existing TestCapacitySchedulerPerf tests that will measure the performance of a configurable number of apps in a configurable number of queues. It will also test the performance of a cluster that has many queues but only a portion of them are active. {code:title=For example:} $ mvn test -Dtest=TestCapacitySchedulerPerf#testUserLimitThroughputWithManyQueues \ -DRunCapacitySchedulerPerfTests=true -DNumberOfQueues=100 \ -DNumberOfApplications=200 \ -DPercentActiveQueues=100 {code} - Parameters: -- RunCapacitySchedulerPerfTests=true: Needed in order to trigger the test -- NumberOfQueues Configurable number of queues -- NumberOfApplications Total number of apps to run in the whole cluster, distributed evenly across all queues -- PercentActiveQueues Percentage of the queues that contain active applications -- This message was sent by Atlassian Jira (v8.3.4#803005) --------------------------------------------------------------------- To unsubscribe, e-mail: yarn-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: yarn-dev-h...@hadoop.apache.org