zhengruifeng opened a new pull request, #56135:
URL: https://github.com/apache/spark/pull/56135
### What changes were proposed in this pull request?
Two follow-ups to the 4.2 PySpark API-reference audit (related: #56115,
#56116):
1. **Add `TwsTester` to the API reference.**
`pyspark.sql.streaming.TwsTester` was added in 4.2 by SPARK-54805 (#53758) but
was never registered in the docs. This PR adds a `tws_tester.rst` page
(mirroring the existing `stateful_processor.rst` pattern) listing all 11 public
methods, and wires it up via `index.rst`.
2. **Fix wrong `versionadded` on `kll_merge_agg_{bigint,float,double}`.**
The three aggregation functions are annotated `.. versionadded:: 4.1.0`, but
the introducing commit (SPARK-54785, `fc15f726eab` on 2026-01-12) landed on
master after v4.1.0 was tagged (2025-12-11). They first appear in
`v4.2.0-preview2`, so the annotation is updated to `4.2.0`.
### Why are the changes needed?
(1) Without the autosummary entries, `TwsTester` does not appear in the
rendered Python docs even though it is public (re-exported in
`pyspark.sql.streaming.__init__`).
(2) The rendered ref pages for the three `kll_merge_agg_*` functions
currently say "New in version 4.1.0", which is misleading — no 4.1.x release
contains them.
### Does this PR introduce _any_ user-facing change?
Documentation-only change. No behavior change.
### How was this patch tested?
Docs-only change. New `tws_tester.rst` follows the same structure as
`stateful_processor.rst`; method list matches the public surface of `TwsTester`
in source order.
### Was this patch authored or co-authored using generative AI tooling?
Generated-by: Claude Code (model: claude-opus-4-7)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
