GitHub user nickpan47 opened a pull request:
https://github.com/apache/samza/pull/351
SAMZA-1482: Restart or fail Samza jobs in YARN when detecting changesâ¦
⦠in input topic partitions
Some high-lights of the changes:
# always instantiating StreamPartitionCountMonitor on all input system
streams now
## it is debatable whether we want to include systems that do not implement
the optimized ExtendedSystemAdmin interface. We may need to configure a long
partition monitor interval for this case and the case where there are tons of
input topics. (Pending perf test)
# moved the instantiation of StreamPartitionCountMonitor out of
JobModelManager and allow ClusterBasedJobCoordinator associate a callback
method directly to the monitor
# allow callbacks to set different application status code before throwing
exception to shutdown the job
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/nickpan47/samza restart-on-partition-change
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/samza/pull/351.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #351
----
commit 30aaa66d8ac9f640dcb6fb117a4e4c2d2e775ecc
Author: Yi Pan (Data Infrastructure) <nickpa...@gmail.com>
Date: 2017-09-25T17:13:46Z
SAMZA-1482: Restart or fail Samza jobs in YARN when detecting changes in
input topic partitions
----
---
