Re: How to trace/debug serialization?

2014-11-06 Thread Shixiong Zhu
:00 nsareen : > Will this work even with Kryo Serialization ? > > > > -- > View this message in context: > http://apache-spark-user-list.1001560.n3.nabble.com/How-to-trace-debug-serialization-tp18230p18319.html > Sent from the Apache Spark User List mailing li

Re: How to trace/debug serialization?

2014-11-06 Thread nsareen
Will this work even with Kryo Serialization ? -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/How-to-trace-debug-serialization-tp18230p18319.html Sent from the Apache Spark User List mailing list archive at Nabble.com

Re: How to trace/debug serialization?

2014-11-05 Thread Shixiong Zhu
ling serialization, and > maybe > how spark decided it needs to be serialized? > > > > -- > View this message in context: > http://apache-spark-user-list.1001560.n3.nabble.com/How-to-trace-debug-serializat

Re: How to trace/debug serialization?

2014-11-05 Thread Sean Owen
been careful > not to reference instance vars in the block. > > Is there a way to see exactly what class is failing serialization, and maybe > how spark decided it needs to be serialized? > > > > -- > View this message in context: > http://apache-spark-user-list.1

Re: How to trace/debug serialization?

2014-11-05 Thread nsareen
>From what i've observed, there are no debug logs while serialization takes place. You can see the source code if you want, TaskSetManager class has some functions for serialization. -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/How-to-tra

How to trace/debug serialization?

2014-11-05 Thread ankits
001560.n3.nabble.com/How-to-trace-debug-serialization-tp18230.html Sent from the Apache Spark User List mailing list archive at Nabble.com. - To unsubscribe, e-mail: user-unsubscr...@spark.apache.org For additional commands, e-mai