Review Request 33487: Bumping up scheduling rate.
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/33487/ --- Review request for Aurora and Bill Farner. Repository: aurora Description --- With the asynchronous preemptor and a series of other perf improvements, our scheduling alrorithm perfomance improved 230X - 270X: Before ``` Benchmark Mode SamplesScore Error Units SchedulingBenchmarks.InsufficientResourcesSchedulingBenchmark.runBenchmark thrpt 100 214.098 ± 2.407 ops/s SchedulingBenchmarks.ConstraintMismatchsSchedulingBenchmark.runBenchmark thrpt 100 180.754 ± 2.407 ops/s ``` After ``` Benchmark Mode Cnt Score Error Units SchedulingBenchmarks.InsufficientResourcesSchedulingBenchmark.runBenchmark thrpt 10 50328.609 ± 1356.151 ops/s SchedulingBenchmarks.ValueConstraintMismatchSchedulingBenchmark.runBenchmark thrpt 10 49237.475 ± 1803.555 ops/s ``` We are only limited by the storage perf now (native + H2). Real life scheduling round latencies are hovering around 25msec on average (SSD-backed native log store), which suggests a new default scheduling rate of 40/sec. Diffs - src/main/java/org/apache/aurora/scheduler/async/AsyncModule.java 35c7e43746783ec81254b473848fb8579f9d233e Diff: https://reviews.apache.org/r/33487/diff/ Testing --- Thanks, Maxim Khutornenko
Re: Review Request 33487: Bumping up scheduling rate.
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/33487/ --- (Updated April 23, 2015, 6:01 p.m.) Review request for Aurora and Bill Farner. Changes --- adding ticket Bugs: AURORA-1214 https://issues.apache.org/jira/browse/AURORA-1214 Repository: aurora Description --- With the asynchronous preemptor and a series of other perf improvements, our scheduling alrorithm perfomance improved 230X - 270X: Before ``` Benchmark Mode SamplesScore Error Units SchedulingBenchmarks.InsufficientResourcesSchedulingBenchmark.runBenchmark thrpt 100 214.098 ± 2.407 ops/s SchedulingBenchmarks.ConstraintMismatchsSchedulingBenchmark.runBenchmark thrpt 100 180.754 ± 2.407 ops/s ``` After ``` Benchmark Mode Cnt Score Error Units SchedulingBenchmarks.InsufficientResourcesSchedulingBenchmark.runBenchmark thrpt 10 50328.609 ± 1356.151 ops/s SchedulingBenchmarks.ValueConstraintMismatchSchedulingBenchmark.runBenchmark thrpt 10 49237.475 ± 1803.555 ops/s ``` We are only limited by the storage perf now (native + H2). Real life scheduling round latencies are hovering around 25msec on average (SSD-backed native log store), which suggests a new default scheduling rate of 40/sec. Diffs - src/main/java/org/apache/aurora/scheduler/async/AsyncModule.java 35c7e43746783ec81254b473848fb8579f9d233e Diff: https://reviews.apache.org/r/33487/diff/ Testing --- Thanks, Maxim Khutornenko
Re: Review Request 33487: Increasing the default scheduling rate limit to 40 attempts per second
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/33487/ --- (Updated April 23, 2015, 6:30 p.m.) Review request for Aurora and Bill Farner. Changes --- Updating summary. Summary (updated) - Increasing the default scheduling rate limit to 40 attempts per second Bugs: AURORA-1214 https://issues.apache.org/jira/browse/AURORA-1214 Repository: aurora Description --- With the asynchronous preemptor and a series of other perf improvements, our scheduling alrorithm perfomance improved 230X - 270X: Before ``` Benchmark Mode SamplesScore Error Units SchedulingBenchmarks.InsufficientResourcesSchedulingBenchmark.runBenchmark thrpt 100 214.098 ± 2.407 ops/s SchedulingBenchmarks.ConstraintMismatchsSchedulingBenchmark.runBenchmark thrpt 100 180.754 ± 2.407 ops/s ``` After ``` Benchmark Mode Cnt Score Error Units SchedulingBenchmarks.InsufficientResourcesSchedulingBenchmark.runBenchmark thrpt 10 50328.609 ± 1356.151 ops/s SchedulingBenchmarks.ValueConstraintMismatchSchedulingBenchmark.runBenchmark thrpt 10 49237.475 ± 1803.555 ops/s ``` We are only limited by the storage perf now (native + H2). Real life scheduling round latencies are hovering around 25msec on average (SSD-backed native log store), which suggests a new default scheduling rate of 40/sec. Diffs - src/main/java/org/apache/aurora/scheduler/async/AsyncModule.java 35c7e43746783ec81254b473848fb8579f9d233e Diff: https://reviews.apache.org/r/33487/diff/ Testing --- Thanks, Maxim Khutornenko
