I am not using kyro. I was using the regular sqlcontext.avrofiles to open. The files loads properly with the schema. Exception happens when I try to read it. Will try kyro serializer and see if that helps. On May 5, 2015 9:02 PM, "Todd Nist" <tsind...@gmail.com> wrote:
> Are you using Kryo or Java serialization? I found this post useful: > > > http://stackoverflow.com/questions/23962796/kryo-readobject-cause-nullpointerexception-with-arraylist > > If using kryo, you need to register the classes with kryo, something like > this: > > > sc.registerKryoClasses(Array( > classOf[ConfigurationProperty], > classOf[Event] > )) > > Or create a registrator something like this: > > class ODSKryoRegistrator extends KryoRegistrator { > override def registerClasses(kryo: Kryo) { > kryo.register(classOf[ConfigurationProperty], new > AvroSerializer[ConfigurationProperty]()) > kryo.register(classOf[Event], new AvroSerializer[Event]())) > } > > I encountered a similar error since several of the Avor core classes are > not marked Serializable. > > HTH. > > Todd > > On Tue, May 5, 2015 at 7:09 PM, Pankaj Deshpande <ppa...@gmail.com> wrote: > >> Hi I am using Spark 1.3.1 to read an avro file stored on HDFS. The avro >> file was created using Avro 1.7.7. Similar to the example mentioned in >> http://www.infoobjects.com/spark-with-avro/ >> I am getting a nullPointerException on Schema read. It could be a avro >> version mismatch. Has anybody had a similar issue with avro. >> >> >> Thanks >> > >
