comphead commented on issue #21034: URL: https://github.com/apache/datafusion/issues/21034#issuecomment-4084140834
Thanks @timsaucer for driving this. While fighting with DF 53 release I would like to share some experience that seemed reasonable to me > What went well? Overall community reaction went well IMO, community made its parts brillianty: - responsibly tests RC - make quick turnaround on found bugs or provide workarounds - support with backports > What could be improved? Release documentation can be improved: - some steps(more specific backports and some other minors) in release process can be elaborated, I'll create a PR soon to address this Code quality can be improved: - it is fine to support more than 1 release, like Apache Spark supports versions 3 and 4 at the same time, but having so many hotfixes suggests some regressions are found on later stages. > What did we learn? Still processing this > What should we commit to changing? - IMO release process needs to be refined - Prerelease verification might include fuzz testing(currently it is pretty limited set), or quasi fuzz testing where genAI generates thousands of valid queries with normal and extreme values - Prerelease verification can also include planner and query benchmarking to identify performance regressions -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
