WweiL opened a new pull request, #37936: URL: https://github.com/apache/spark/pull/37936
<!-- Please read [go/dbr-dev-guides](https://go/dbr-dev-guides/) before creating a pull request against files shared between Databricks Runtime and open-source Apache Spark. For example, this includes files under the `org.apache.spark` package path. If in doubt, please reach out to a member of the open-source team for help. --> ## What changes were proposed in this pull request? Add complex tests to `StreamingSessionWindowSuite`. Concretely, I created two helper functions, - one is called `sessionWindowQueryNestedKey`, which would convert `sessionId` from the single word key used in `sessionWindowQuery` to a nested column key. For example: `"hello" -> (("hello", "hello"), "hello")`. - The other is called `sessionWindowQueryMultiColKey`. It would convert `sessionId` from the single word key used in `sessionWindowQuery` to two columns. For example: "hello" -> col1: ("hello", "hello"), col2: "hello" With the two new helper functions, I added more tests for the tests for `complete mode` and `append mode`, also for `cap gap duration` and `async state`. The logic of the tests are not changed at all, just the key. For the aggregation test (`session window - with more aggregation functions`), I added some more functions to test, and I tried `first()` and `last()` function on a nested triple, created using the same method as the above. <!-- Please fill in changes proposed in this fix. --> ## How was this patch tested? All are tests. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
