Re: How does preprocessing fit into Spark MLlib pipeline

2017-05-16 Thread Adrian Stern
gt;>> fit >>> as part of a pipeline, what is the best way to include it in my code so >>> that >>> it can easily be reused both for training and testing, as well as in >>> production. >>> >>> I'm using pyspark 2.1 and here is a

Re: How does preprocessing fit into Spark MLlib pipeline

2017-03-20 Thread Yan Facai
an-t-a-Transformer-have-multiple-output-columns-td18689.html >> <http://apache-spark-developers-list.1001551.n3.nabble.com/ >> Why-can-t-a-Transformer-have-multiple-output-columns-td18689.html> >> >> Thanks >> Adrian >> >> >> >> >> -- >> View this message in context: http://apache-spark-user-list. >> 1001560.n3.nabble.com/How-does-preprocessing-fit-into-Spark- >> MLlib-pipeline-tp28473.html >> Sent from the Apache Spark User List mailing list archive at Nabble.com. >> >> - >> To unsubscribe e-mail: user-unsubscr...@spark.apache.org >> >> >

Re: How does preprocessing fit into Spark MLlib pipeline

2017-03-17 Thread Yanbo Liang
spark-developers-list.1001551.n3.nabble.com/Why-can-t-a- > Transformer-have-multiple-output-columns-td18689.html > <http://apache-spark-developers-list.1001551.n3.nabble.com/Why-can-t-a- > Transformer-have-multiple-output-columns-td18689.html> > > Thanks > Adrian > >

How does preprocessing fit into Spark MLlib pipeline

2017-03-09 Thread aATv
apache-spark-developers-list.1001551.n3.nabble.com/Why-can-t-a-Transformer-have-multiple-output-columns-td18689.html> Thanks Adrian -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/How-does-preprocessing-fit-into-Spark-MLlib-pipeline-tp28473.html Sent