Re: Sink Processor definition

2017-06-03 Thread Matthias J. Sax
I think "sink" it the correct term here. It means that we write to a topic. Processors, that don't have downstream nodes are called "terminal operation" (at least in the DSL). Thus, a sink is also a "terminal operation" but not the other way round. So the docs are not optimal, as they put the

Re: Sink Processor definition

2017-06-03 Thread Michal Borowiecki
Yes, I think the key distinction, from the point of view of that documentation section, is that it doesn't have downstream processors. On 03/06/17 09:48, Damian Guy wrote: Hi Michal, In this case Sink Processor is really referring to a SinkNode that can only produce to a kafka topic. Maybe

Re: Sink Processor definition

2017-06-03 Thread Damian Guy
Hi Michal, In this case Sink Processor is really referring to a SinkNode that can only produce to a kafka topic. Maybe the terminology is incorrect as strictly speaking a processor that writes data to anything could be considered a Sink Processor. On Sat, 3 Jun 2017 at 09:23 Michal Borowiecki

Sink Processor definition

2017-06-03 Thread Michal Borowiecki
Hi all, Streams docs say: * *Sink Processor*: A sink processor is a special type of stream processor that does not have down-stream processors. It sends any received records from its up-stream processors to a specified Kafka topic. Would a processor that doesn't produce to a