GitHub user WeichenXu123 opened a pull request:
https://github.com/apache/spark/pull/19979
[SPARK-22644][ML][TEST][FOLLOW-UP] ML regression testsuite add
StructuredStreaming test
## What changes were proposed in this pull request?
ML regression testsuite add StructuredStreaming test
In order to make testsuite easier to modify, new helper function added in
`MLTest`:
```
def testTransformerByGlobalCheckFunc[A : Encoder](
dataframe: DataFrame,
transformer: Transformer,
firstResultCol: String,
otherResultCols: String*)
(globalCheckFunction: Seq[Row] => Unit): Unit
```
## How was this patch tested?
N/A
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/WeichenXu123/spark ml_stream_test
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/19979.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #19979
----
commit 47dccdd2531f8f84f38c75139d9223c682a089d6
Author: WeichenXu <weichen...@databricks.com>
Date: 2017-12-14T12:14:56Z
init pr
----
---
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
