yaooqinn opened a new pull request, #54061: URL: https://github.com/apache/spark/pull/54061
### What changes were proposed in this pull request? All DataSketches-related expression functions should have their own `sketch_funcs` group instead of being grouped under `misc_funcs`. Move all sketch-related expression functions from `misc_funcs` to `sketch_funcs`: - **HLL sketch functions**: `hll_sketch_estimate`, `hll_union` - **Theta sketch functions**: `theta_sketch_estimate`, `theta_union`, `theta_difference`, `theta_intersection` - **KLL sketch functions**: `kll_sketch_to_string_*`, `kll_sketch_get_n_*`, `kll_sketch_get_rank_*`, `kll_sketch_get_quantile_*`, `kll_sketch_get_pmf_*`, `kll_sketch_get_cdf_*`, `kll_sketch_merge_*` - **Tuple sketch functions**: `tuple_sketch_*` expression functions - **ApproxTopK**: `approx_top_k_estimate` Add `sketch_funcs` to the groups set in `gen-sql-functions-docs.py`. Note: Aggregate functions (like `hll_sketch_agg`, `theta_sketch_agg`, `kll_sketch_agg_*`, etc.) remain in `agg_funcs`. ### Why are the changes needed? This PR moves **34 DataSketches-related expression functions** from `misc_funcs` to a dedicated `sketch_funcs` group. These 34 functions represent over 60% of all `misc_funcs`, making `misc_funcs` a catch-all bucket that reduces documentation clarity. By creating `sketch_funcs`, we achieve consistency with other specialized function groups (`avro_funcs`, `json_funcs`, `csv_funcs`, `xml_funcs`, etc.) and make it easier for users to discover and understand DataSketches functionality in Spark SQL. ### Does this PR introduce _any_ user-facing change? No functional changes. The only difference is in how functions are grouped in documentation. ### How was this patch tested? Existing tests. ### Was this patch authored or co-authored using generative AI tooling? Yes, GitHub Copilot was used to assist with this change. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
