srowen commented on pull request #32648: URL: https://github.com/apache/spark/pull/32648#issuecomment-960980974
Hm, that's weird. So this is a pre-existing problem, appears with 2.12 too? I wonder why we haven't seen it before though. I think the issue is that Kryo pre-registers a bunch of classes, including some from Spark ML. YARN doesn't depend on Spark ML though, so it doesn't see breeze. (But I wonder why this hasn't arisen before.) I could imagine it happens to work out somehow if you pre-build Spark entirely. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
