Assuming you are talking about Spark Streaming
1) How to analyze what part of code executes on Spark Driver and what part
of code executes on the executors?
RDD's can be understood as set of data transformations or set of jobs. Your
understanding deepens as you do more programming with Spark.
Hi All,
A cluster of one spark driver and multiple executors(5) is setup with redis
for spark processed data storage and s3 is used for checkpointing. I have a
couple of queries about this setup.
1) How to analyze what part of code executes on Spark Driver and what part
of code executes on the
