GitHub user attilapiros opened a pull request:
https://github.com/apache/spark/pull/20686
[SPARK-22915][MLlib] Streaming tests for spark.ml.feature, from N to Z
# What changes were proposed in this pull request?
Adds structured streaming tests using testTransformer for these suites:
- NGramSuite.scala
- NormalizerSuite.scala
- OneHotEncoderEstimatorSuite.scala
- OneHotEncoderSuite.scala
- PCASuite.scala
- PolynomialExpansionSuite.scala
- QuantileDiscretizerSuite.scala
- RFormulaSuite.scala
- SQLTransformerSuite.scala
- StandardScalerSuite.scala
- StopWordsRemoverSuite.scala
- StringIndexerSuite.scala
- TokenizerSuite.scala
- VectorIndexerSuite.scala
- VectorSizeHintSuite.scala
- VectorSlicerSuite.scala
- Word2VecSuite.scala
# How was this patch tested?
They are unit test.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/attilapiros/spark SPARK-22915
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/20686.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #20686
----
commit 4099c85e94fabdc4848acf54a9d2704d4f3f5246
Author: âattilapirosâ <piros.attila.zsolt@...>
Date: 2018-02-23T17:27:46Z
initial upload
----
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
