----------------------------------------------------------- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/36471/ -----------------------------------------------------------
(Updated July 14, 2015, 1:25 a.m.) Review request for samza and Navina Ramesh. Summary (updated) ----------------- Autoscaling for samza (work in progress) Repository: samza Description (updated) ------- This work is for SAMZA-719. Currently, a fixed number of containers is assigned to a job as an input configuration parameter. However, with this design jobs can fail due to lack of enough resources (such as memory), or they can become a bottleneck in a workflow containing many jobs. While auto-scaling is much broader term, the goal of this project will be to enable a Samza job to automatically scale its containers such that there is improved job performance. Based on the design, we need a profiler, analyser, optimizer and deployer module. -currently profiler and analyzer added. -tests not added for those components, and further testing is needed. Diffs ----- checkstyle/import-control.xml 3374f0c432e61ac4cda275377604cfd481f0cddf samza-api/src/main/java/org/apache/samza/autoScaling/AutoScalingMode.java PRE-CREATION samza-api/src/main/java/org/apache/samza/autoScaling/Profiler.java PRE-CREATION samza-api/src/main/java/org/apache/samza/autoScaling/analyzer/Analyzer.java PRE-CREATION samza-core/src/main/java/org/apache/samza/autoScaling/AutoScalingSystem.java PRE-CREATION samza-core/src/main/java/org/apache/samza/autoScaling/SnapshotReporterProfiler.java PRE-CREATION samza-core/src/main/java/org/apache/samza/autoScaling/analyzer/MemoryAnalyzer.java PRE-CREATION samza-core/src/main/java/org/apache/samza/autoScaling/metrics/MemoryMetrics.java PRE-CREATION samza-core/src/main/java/org/apache/samza/autoScaling/metrics/SlidingWindowMetric.java PRE-CREATION samza-core/src/main/java/org/apache/samza/autoScaling/stream/AutoScalingMetricsSystemConsumer.java PRE-CREATION samza-core/src/main/scala/org/apache/samza/autoScaling/stream/AutoScalingMetricsSystemFactory.scala PRE-CREATION samza-core/src/main/scala/org/apache/samza/config/AutoScalingConfigRewriter.scala PRE-CREATION samza-core/src/main/scala/org/apache/samza/config/JobConfig.scala e4b14f4da6649eb78753ba3b3f529373b6f2dbe4 samza-core/src/main/scala/org/apache/samza/metrics/JvmMetrics.scala a95a0ecde300f6576fe46b37d5898e3d21634126 samza-core/src/main/scala/org/apache/samza/util/Util.scala 2feb65b729b45fbc3b83a75c4072527e3c4e60be samza-core/src/test/java/org/apache/samza/autoScaling/SlidingWindowMetricTest.java PRE-CREATION Diff: https://reviews.apache.org/r/36471/diff/ Testing ------- Thanks, Shadi A. Noghabi
