[
https://issues.apache.org/jira/browse/SPARK-2197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14078675#comment-14078675
]
Joseph K. Bradley edited comment on SPARK-2197 at 7/30/14 12:18 AM:
--------------------------------------------------------------------
This error is at least partly caused by issues with collect() inside
DecisionTree: https://issues.apache.org/jira/browse/SPARK-2737
was (Author: josephkb):
This error is at least partly caused by issues with collect() inside
DecisionTree.
> Spark invoke DecisionTree by Java
> ---------------------------------
>
> Key: SPARK-2197
> URL: https://issues.apache.org/jira/browse/SPARK-2197
> Project: Spark
> Issue Type: Bug
> Components: MLlib
> Reporter: wulin
> Assignee: Joseph K. Bradley
>
> Strategy strategy = new Strategy(Algo.Classification(), new Impurity() {
> @Override
> public double calculate(double arg0, double arg1,
> double arg2) {
> return Gini.calculate(arg0, arg1, arg2);
> }
> @Override
> public double calculate(double arg0, double arg1) {
> return Gini.calculate(arg0, arg1);
> }
> }, 5, 100, QuantileStrategy.Sort(), null, 256);
> DecisionTree decisionTree = new DecisionTree(strategy);
> final DecisionTreeModel decisionTreeModel =
> decisionTree.train(labeledPoints.rdd());
> i try to run it on spark, but find an error on the console:
> java.lang.ClassCastException: [Ljava.lang.Object; cannot be cast to
> [Lorg.apache.spark.mllib.regression.LabeledPoint;
> at
> org.apache.spark.mllib.tree.DecisionTree$.findSplitsBins(DecisionTree.scala:990)
> at org.apache.spark.mllib.tree.DecisionTree.train(DecisionTree.scala:56)
> at
> org.project.modules.spark.java.SparkDecisionTree.main(SparkDecisionTree.java:75)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:601)
> at org.apache.spark.deploy.SparkSubmit$.launch(SparkSubmit.scala:292)
> at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:55)
> at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)
> i view source code, find
> val numFeatures = input.take(1)(0).features.size
> this is a problem.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
