Re: Getting the best parameter set back from CrossValidatorModel

2015-05-19 Thread Joseph Bradley
Hi Justin & Ram, To clarify, PipelineModel.stages is not private[ml]; only the PipelineModel constructor is private[ml]. So it's safe to use pipelineModel.stages as a Spark user. Ram's example looks good. Btw, in Spark 1.4 (and the current master build), we've made a number of improvements to P

Re: Getting the best parameter set back from CrossValidatorModel

2015-05-17 Thread Justin Yip
Thanks Ram. Your sample look is very helpful. (there is a minor bug that PipelineModel.stages is hidden under private[ml], just need a wrapper around it. :) Justin On Sat, May 16, 2015 at 10:44 AM, Ram Sriharsha wrote: > Hi Justin > > The CrossValidatorExample here > https://github.com/apache/

Re: Getting the best parameter set back from CrossValidatorModel

2015-05-16 Thread Ram Sriharsha
Hi Justin The CrossValidatorExample here https://github.com/apache/spark/blob/master/examples/src/main/scala/org/apache/spark/examples/ml/CrossValidatorExample.scala is a good example of how to set up an ML Pipeline for extracting a model with the best parameter set. You set up the pipeline as in