Jake Maes created SAMZA-1075:
--------------------------------
Summary: Refactor SystemAdmin Interface to expose a common method
to create streams.
Key: SAMZA-1075
URL: https://issues.apache.org/jira/browse/SAMZA-1075
Project: Samza
Issue Type: Bug
Reporter: Jake Maes
Assignee: Jake Maes
With samza-1041, we plan to automatically create intermediate streams for a
given graph. To do this, we need a generic way to create streams on all
supported systems.
We currently auto-create streams for checkpoints, coordinatorStream, and
changelogs, we do so using a fragmented set of interfaces and methods. e.g. to
create a checkpoint topic, the KafkaCheckpointMnager.start() creates the topic
using KafkaUtil directly, whereas for the coordinatorStream, we call the
SystemAdmin.createCoordinatorStream() method. The former is specific to a
particular System, but the latter is theoretically (but not actually)
implemented for every System.
Instead of using custom methods in differing levels of abstraction, we should
just expose one simple createStream() method in the SystemAdmin interface and
deprecate the old methods. The new createStream method will receive a complete,
system-specific blueprint/specification for the stream and use that to create
the actual stream.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
