You can do grid search if you set the evaluator to a MulticlassClassificationEvaluator, which expects a prediction column, not a rawPrediction column. There's a JIRA for making BinaryClassificationEvaluator accept prediction instead of rawPrediction. Joseph
On Tue, Dec 1, 2015 at 5:10 AM, Benjamin Fradet <benjamin.fra...@gmail.com> wrote: > Someone correct me if I'm wrong but no there isn't one that I am aware of. > > Unless someone is willing to explain how to obtain the raw prediction > column with the GBTClassifier. In this case I'd be happy to work on a PR. > On 1 Dec 2015 8:43 a.m., "Ndjido Ardo BAR" <ndj...@gmail.com> wrote: > >> Hi Benjamin, >> >> Thanks, the documentation you sent is clear. >> Is there any other way to perform a Grid Search with GBT? >> >> >> Ndjido >> On Tue, 1 Dec 2015 at 08:32, Benjamin Fradet <benjamin.fra...@gmail.com> >> wrote: >> >>> Hi Ndjido, >>> >>> This is because GBTClassifier doesn't yet have a rawPredictionCol like >>> the. RandomForestClassifier has. >>> Cf: >>> http://spark.apache.org/docs/latest/ml-ensembles.html#output-columns-predictions-1 >>> On 1 Dec 2015 3:57 a.m., "Ndjido Ardo BAR" <ndj...@gmail.com> wrote: >>> >>>> Hi Joseph, >>>> >>>> Yes Random Forest support Grid Search on Spark 1.5.+ . But I'm getting >>>> a "rawPredictionCol field does not exist exception" on Spark 1.5.2 for >>>> Gradient Boosting Trees classifier. >>>> >>>> >>>> Ardo >>>> On Tue, 1 Dec 2015 at 01:34, Joseph Bradley <jos...@databricks.com> >>>> wrote: >>>> >>>>> It should work with 1.5+. >>>>> >>>>> On Thu, Nov 26, 2015 at 12:53 PM, Ndjido Ardo Bar <ndj...@gmail.com> >>>>> wrote: >>>>> >>>>>> >>>>>> Hi folks, >>>>>> >>>>>> Does anyone know whether the Grid Search capability is enabled since >>>>>> the issue spark-9011 of version 1.4.0 ? I'm getting the "rawPredictionCol >>>>>> column doesn't exist" when trying to perform a grid search with Spark >>>>>> 1.4.0. >>>>>> >>>>>> Cheers, >>>>>> Ardo >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> --------------------------------------------------------------------- >>>>>> To unsubscribe, e-mail: user-unsubscr...@spark.apache.org >>>>>> For additional commands, e-mail: user-h...@spark.apache.org >>>>>> >>>>>> >>>>>
