LuciferYang commented on PR #37206: URL: https://github.com/apache/spark/pull/37206#issuecomment-1194977762
> Thanks for the detailed analysis @JoshRosen - I agree with your analysis. I saw two cases where this could be happening - > > * test code or user code calling spark-internal api, > * Some nontrivial code flow, where either deserialization is happening lazily (and I would love to see a reproducible testcase for this), or some other nontrivial interaction - like the ones you detailed. > > Agree, we should get more details on this before changing the type/other fixes. Agree +1, we need more details -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
