andygrove opened a new pull request, #6568: URL: https://github.com/apache/datafusion-comet/pull/6568
## Which issue does this PR close? N/A. This reruns the ["Generate Release Documentation"](https://github.com/apache/datafusion-comet/blob/main/docs/source/contributor-guide/release_process.md#generate-release-documentation) step of the 1.1.0 release (#5327) for rc2. The first run, #6344, came before the backports that merged after rc1. ## Rationale for this change A release branch commits the generated docs under `docs/source/user-guide/latest/`, so the archived 1.1.0 docs render real tables. Some backports since #6344 change what the generator writes. #6488 added a config key, and #6489 and #6561 made the `regr_*` aggregates, `array_distinct` and `array_union` fall back to Spark by default. Without this, the 1.1.0 docs would leave out the new key and the reasons those expressions fall back. ## What changes are included in this PR? Output of `./dev/generate-release-docs.sh` on `branch-1.1` at 4f5cf2db1e, with no hand edits: - `configs.md`: a row for `spark.comet.exec.aggregate.skipPartial.enabled` (#6488). The only other key added since #6344, `spark.comet.testing.icebergWriteReport.dir` (#6307), is internal, so the generator leaves it out. - `compatibility/expressions/spark-{3.4,3.5,4.0,4.1}/aggregate.md`: why `RegrIntercept`, `RegrR2`, `RegrReplacement`, `RegrSXY` and `RegrSlope` fall back by default (#6489, the backport of #6451). - `compatibility/expressions/spark-{3.4,3.5,4.0,4.1}/array.md`: why `ArrayDistinct` and `ArrayUnion` fall back by default for floating-point elements (#6561, the backport of #5750). - `expressions.md`: the Implementation column for `regr_sxx` and `regr_syy` goes back to the em-dash placeholder that #6344 generated. #6489 set it to "Native" when it added the fallback notes, which stay. The generator can't resolve these two rows because Spark rewrites both functions to `RegrReplacement` before Comet sees the plan, as #6344 describes. The four Spark versions get the same additions. ## How are these changes tested? - `./dev/generate-release-docs.sh` completed for all four Spark profiles on JDK 17. - `npx prettier@latest --check` passes on the changed files. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
