bartosz25 opened a new pull request, #41988: URL: https://github.com/apache/spark/pull/41988
### What changes were proposed in this pull request? Improve the code comments: 1. Rate micro-batch data source Scaladoc parameters aren't consistent with the options really supported by this data source. 2. The `getCurrentWatermarkMs` has a special semantic for the 1st micro-batch when the watermark is not set yet. IMO, it should return `Option[Long]`, hence `None` instead of `0` for the first micro-batch, but since it's a breaking change, I preferred to add a note on that instead. ### Why are the changes needed? 1. Avoid confusion while using the classes and methods. ### Does this PR introduce _any_ user-facing change? No. ### How was this patch tested? The tests weren't added because the change is only at the Scaladoc level. I affirm that the contribution is my original work and that I license the work to the project under the project's open source license. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
