Hi Cesar, Thanks for trying out Pipelines and bringing up this issue! It's been an experimental API, but feedback like this will help us prepare it for becoming non-Experimental. I've made a JIRA, and will vote for this being protected (instead of private[ml]) for Spark 1.3: https://issues.apache.org/jira/browse/SPARK-5902
Thanks again, Joseph On Wed, Feb 18, 2015 at 12:17 PM, Cesar Flores <ces...@gmail.com> wrote: > > I am working right now with the ML pipeline, which I really like it. > However in order to make a real use of it, I would like create my own > transformers that implements org.apache.spark.ml.Transformer. In order to > do that, a method from the PipelineStage needs to be implemented. But this > method is private to the ml package: > > private[ml] def transformSchema(schema: StructType, paramMap: ParamMap): > StructType > > Do any user can create their own transformers? If not, do this > functionality will be added in the future. > > Thanks > -- > Cesar Flores >
