andygrove opened a new pull request, #198: URL: https://github.com/apache/datafusion-site/pull/198
Draft release announcement for Apache DataFusion Comet 0.17.0. The post is structured as a standard PMC release announcement, with the focus on this cycle's headline work: - **Arrow-native framing**: leads with the "Arrow-native end to end" value proposition and the Rust-implemented vs JVM-implemented distinction, following the nomenclature direction in apache/datafusion-comet#4419. - **JVM codegen dispatch**: the maturation of the codegen dispatcher (Scala/Java UDFs enabled by default, 100% Spark-compatible regex and JSON, additional scalar/text functions, and the `Incompatible`-to-dispatch change). - **Expanded expression coverage**: more than 120 Spark expressions newly supported since 0.16.0, curated by category. - **Performance**: removing the Arrow FFI round trip and per-batch deep copy from the native shuffle write path, Arrow vector buffer-address caching, and `GroupsAccumulator` for statistical aggregates. - **Correctness**: the cross-version expression audits, framed as preparation toward a future 1.0.0 release. Opening as a **draft** because the following still need to be finalized at release time (flagged with a TODO comment in the post): - Release date (filename and front matter currently use a placeholder) - PR count and contributor count (to be confirmed against the generated `dev/changelog/0.17.0.md`) - The expressions reference, installation, and changelog links assume the standard release-doc publishing Feedback welcome on scope: a few other 0.17.0 themes (Iceberg `RewriteDataFiles` native scan, `NullType` shuffle support, pluggable S3 credentials) were intentionally left out to keep the focus tight. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
