Map Partition is called Multiple Times

I am trying to run a spark job which performs some database operations and saves passed records in one table and the failed ones in another. Here is the code for the same: ``` log.info("Starting the spark job {}"); String sparkAppName = generateSparkAppName("reading-graph"); SparkConf sparkConf

Dependency injection for spark executors

I am writing a spark application which uses java and spring boot to process rows. For every row it performs some logic and saves data into the database. The logic is performed using some services defined in my application and some external