I have a Spark job that computes some values and needs to write those values to a data store. The classes that write to the data store are not serializable (eg, Cassandra session objects etc).
I don't want to collect all the results at the driver, I want each worker to write the data - what is the suggested approach for using code that can't be serialized in a task?
