Hi I want to understand the flow of spark streaming with kafka.
In spark Streaming is the executor nodes at each run of streaming interval same or At each stream interval cluster manager assigns new executor nodes for processing this batch input. If yes then at each batch interval new executors register themselves as kafka consumers? Even without kafka is executor nodes on each batch interval same or driver nodes gets new executor nodes from cluster manager ? Thanks Shushant
