lakshmi-manasa-g opened a new pull request, #1596: URL: https://github.com/apache/samza/pull/1596
Feature: Elasticity (SAMZA-2687) for a Samza job allows job to have more tasks than the number of input SystemStreamPartition(SSP). Thus, a job can scale up beyond its input partition count without needing the repartition the input stream. Changes: When elasticity is enabled, change the task name as follows 1. GroupByPartition SSP grouper: from "Partition 0 1" to "Partition 0_1_2" where 0 is the input partition, 1 is the keyBucket and 2 is the elasticity factor. 2. GroupBySystemStreamPartition SSP grouper: from "SystemStreamPartition [systemA, streamB, 0, 1]" to "SystemStreamPartition [systemA, streamB, 0, 1]_2" where 0 is the input partition, 1 is the keyBucket and 2 is the elasticity factor. Tests: updated existing tests API changes: none Usage/ upgrade instructions: applicable when "job.elasticity.factor" is set to >1 Backwards compatible: yes. does not affect task name format when elasticity is disabled. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
