Re: Spark serialization issues with third-party libraries

2014-11-24 Thread jatinpreet
Thanks Arush! Your example is nice and easy to understand. I am implementing it through Java though. Jatin - Novice Big Data Programmer -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Spark-serialization-issues-with-third-party-libraries-tp19454p19624

Re: Spark serialization issues with third-party libraries

2014-11-24 Thread Arush Kharbanda
mer > -- > View this message in context: > http://apache-spark-user-list.1001560.n3.nabble.com/Spark-serialization-issues-with-third-party-libraries-tp19454p19589.html > Sent from the Apache Spark User List mailing list archive at Nabble.com. > > ---

Re: Spark serialization issues with third-party libraries

2014-11-23 Thread jatinpreet
make some class members transient. http://spark-summit.org/2014/talk/leveraging-uima-in-spark Thanks - Novice Big Data Programmer -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Spark-serialization-issues-with-third-party-libraries-tp19454p19589.html

Re: Spark serialization issues with third-party libraries

2014-11-21 Thread Sean Owen
explain which classes need to be Serializable and which of them can > be left as it is? A clear understanding will help me a lot. > > Thanks, > Jatin > > > > - > Novice Big Data Programmer > -- > View this message in context: > http://apache-spark-user-list.

Spark serialization issues with third-party libraries

2014-11-20 Thread jatinpreet
explain which classes need to be Serializable and which of them can be left as it is? A clear understanding will help me a lot. Thanks, Jatin - Novice Big Data Programmer -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Spark-serialization-issues-with-third