Re: Using a non serializable third party JSON serializable on a spark worker node throws NotSerializableException

Could you show the full companion object? It looks weird that having `override` in a companion object of a case class. On Tue, Mar 1, 2016 at 11:16 AM, Yuval Itzchakov wrote: > As I said, it is the method which eventually serializes the object. It is > declared inside a

Re: Using a non serializable third party JSON serializable on a spark worker node throws NotSerializableException

As I said, it is the method which eventually serializes the object. It is declared inside a companion object of a case class. The problem is that Spark will still try to serialize the method, as it needs to execute on the worker. How will that change the fact that `EncodeJson[T]` is not

Re: Using a non serializable third party JSON serializable on a spark worker node throws NotSerializableException

Don't know where "argonaut.EncodeJson$$anon$2" comes from. However, you can always put your codes into an method of an "object". Then just call it like a Java static method. On Tue, Mar 1, 2016 at 10:30 AM, Yuval.Itzchakov wrote: > I have a small snippet of code which relays

Using a non serializable third party JSON serializable on a spark worker node throws NotSerializableException

I have a small snippet of code which relays on argonaut for JSON serialization which is ran from a `PairRDDFunctions.mapWithState` once a session is completed. This is the code snippet (not that important): override def sendMessage(pageView: PageView): Unit = {