srowen commented on pull request #34474: URL: https://github.com/apache/spark/pull/34474#issuecomment-959610670
Looking at the implementation, it's never meant to be serialized by Java or Kryo, but is serialized 'manually' and internally by Spark. I think it must be related to observe() here, that somehow this object gets caught up in what is returned? I don't know a lot about observe(). It's possible the answer is that observe() should do something different, but not sure. We can make this Serializable, but then need to implement methods for the Java serializer that would reuse the existing serializer code. That seems plausible. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
