Hi, I am using Spar 1.5 and ML Pipeline. I create the model then give the model unlabeled data to find the probabilites and predictions. When I want to see the results, it returns me error.
//creating model final PipelineModel model = pipeline.fit(trainingData); JavaRDD<Row> rowRDD1 = unlabeledTest .map(new Function<Tuple2<String, Vector>, Row>() { @Override public Row call(Tuple2<String, Vector> arg0) throws Exception { return RowFactory.create(arg0._1(), arg0._2()); } }); // creating dataframe from row DataFrame production = sqlContext.createDataFrame(rowRDD1, new StructType(new StructField[] { new StructField("id", DataTypes.StringType, false, Metadata.empty()), new StructField("features", (new VectorUDT()), false, Metadata.empty()) })); DataFrame predictionsProduction = model.transform(production); *//produces the error* *predictionsProduction.select("id","features","probability").show(5);* Here is my code, am I wrong at creating rowRDD1 or production ? error : java.util.NoSuchElementException: key not found: 1.0 at scala.collection.MapLike$class.default(MapLike.scala:228) at scala.collection.AbstractMap.default(Map.scala:58) at scala.collection.MapLike$class.apply(MapLike.scala:141) at scala.collection.AbstractMap.apply(Map.scala:58) ..... How can I solve it ? Thanks. Have a nice day, yasemin -- hiç ender hiç