pan3793 commented on PR #53217: URL: https://github.com/apache/spark/pull/53217#issuecomment-3578767090
@gengliangwang, I think this is an expected behavior, SPARK-53064 only provides a feasible approach to allow developers to write a custom `LogKey` that keeps binary compatibility with Spark 4.0 and 4.1. From my knowledge, downstream projects that heavily use the Spark internal API are hard to maintain binary compatibility across Spark feature versions. One example is that Iceberg used to do that in the Spark 3.0 and 3.1 period, and decided to abandon that after a short time. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
