Martin Menestret created SPARK-9690:
---------------------------------------
Summary: Adding the possibility to set the seed of the rand in the
CrossValidator fold
Key: SPARK-9690
URL: https://issues.apache.org/jira/browse/SPARK-9690
Project: Spark
Issue Type: Improvement
Components: ML
Affects Versions: 1.4.1
Reporter: Martin Menestret
Priority: Minor
Fix For: 1.5.0
The fold in the ML CrossValidator depends on a rand whose seed is set to 0 and
it leads the sql.functions rand to call sc._jvm.functions.rand() with no seed.
In order to be able to unit test a Cross Validation it would be a good idea to
be able to set this seed so the output of the cross validation (with a
featureSubsetStrategy set to "all") would always be the same.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]