mridulm commented on PR #37206: URL: https://github.com/apache/spark/pull/37206#issuecomment-1194965436
Thanks for the detailed analysis @JoshRosen - I agree with your analysis. I saw two cases where this could be happening - * test code or user code calling spark-internal api, * Some nontrivial code flow, where either deserialization is happening lazily (and I would love to see a reproducible testcase for this), or some other nontrivial interaction - like the ones you detailed. Agree, we should get more details on this before changing the type. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
