cloud-fan commented on PR #53143: URL: https://github.com/apache/spark/pull/53143#issuecomment-3574418152
OK let's define the expected behaviors in detail. We all agree that refresh cache shouldn't fail due to version refresh, but what exactly is the expectation? Recache means re-plan the cached logical plan, so the result schema can't change. If the new table version is compatible, it's the happy path and we just refresh the cache with the new table versions. But if it's not compatible, then there is no point to keep the cache entry and we can invalidate the cache? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
