Its not used as default serializer for some issues with compatibility & requirement to register the classes..
Which part are you getting as nonserializable... you need to serialize that class if you are sending it to spark workers inside a map, reduce , mappartition or any of the operations on RDD. Mayur Rustagi Ph: +1 (760) 203 3257 http://www.sigmoidanalytics.com @mayur_rustagi <https://twitter.com/mayur_rustagi> On Wed, Jun 25, 2014 at 4:52 AM, Peng Cheng <pc...@uow.edu.au> wrote: > I'm afraid persisting connection across two tasks is a dangerous act as > they > can't be guaranteed to be executed on the same machine. Your ES server may > think its a man-in-the-middle attack! > > I think its possible to invoke a static method that give you a connection > in > a local 'pool', so nothing will sneak into your closure, but its too > complex > and there should be a better option. > > Never use kryo before, if its that good perhaps we should use it as the > default serializer > > > > -- > View this message in context: > http://apache-spark-user-list.1001560.n3.nabble.com/ElasticSearch-enrich-tp8209p8222.html > Sent from the Apache Spark User List mailing list archive at Nabble.com. >
