[jira] [Commented] (SPARK-21482) Make LabeledPoint bean-compliant so it can be used in Encoders.bean(LabeledPoint.class)
[ https://issues.apache.org/jira/browse/SPARK-21482?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16094315#comment-16094315 ] Aseem Bansal commented on SPARK-21482: -- There is a LabeledPoint in new ml api too https://spark.apache.org/docs/2.1.0/api/scala/index.html#org.apache.spark.ml.feature.LabeledPoint I am able to workaround via using my own class. But I thought the ML package was supposed to be used with the dataset's API. That's why I am saying it should support this. > Make LabeledPoint bean-compliant so it can be used in > Encoders.bean(LabeledPoint.class) > --- > > Key: SPARK-21482 > URL: https://issues.apache.org/jira/browse/SPARK-21482 > Project: Spark > Issue Type: Improvement > Components: ML >Affects Versions: 2.1.0 >Reporter: Aseem Bansal >Priority: Minor > > The LabeledPoint class is currently not bean-compliant as per spark > https://spark.apache.org/docs/2.1.0/api/scala/index.html#org.apache.spark.ml.feature.LabeledPoint > This makes it impossible to create a LabeledPoint via a dataset.tranform. It > should be made bean-compliant so it can be used. -- This message was sent by Atlassian JIRA (v6.4.14#64029) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-21482) Make LabeledPoint bean-compliant so it can be used in Encoders.bean(LabeledPoint.class)
[ https://issues.apache.org/jira/browse/SPARK-21482?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16094305#comment-16094305 ] Sean Owen commented on SPARK-21482: --- When using LabeledPoint you're typically using the RDD API, where Encoders aren't needed. Do you really need a DataSet? or, if you're out of .mllib code, why not use your own type and not link yourself to the internal .mllib rep? > Make LabeledPoint bean-compliant so it can be used in > Encoders.bean(LabeledPoint.class) > --- > > Key: SPARK-21482 > URL: https://issues.apache.org/jira/browse/SPARK-21482 > Project: Spark > Issue Type: Improvement > Components: ML >Affects Versions: 2.1.0 >Reporter: Aseem Bansal >Priority: Minor > > The LabeledPoint class is currently not bean-compliant as per spark > https://spark.apache.org/docs/2.1.0/api/scala/index.html#org.apache.spark.ml.feature.LabeledPoint > This makes it impossible to create a LabeledPoint via a dataset.tranform. It > should be made bean-compliant so it can be used. -- This message was sent by Atlassian JIRA (v6.4.14#64029) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-21482) Make LabeledPoint bean-compliant so it can be used in Encoders.bean(LabeledPoint.class)
[ https://issues.apache.org/jira/browse/SPARK-21482?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16094295#comment-16094295 ] Aseem Bansal commented on SPARK-21482: -- I am using Java API. I tried a simple transformation with {noformat} dataset.transform(MyCustomToLabeledPointTransformer::transformer, Encoders.bean(LabeledPoint.class)) {noformat} and it threw bean-compliance exception. I am not sure whether the encoders should act on beans or not but clearly something is going on due to which they are acting on beans. > Make LabeledPoint bean-compliant so it can be used in > Encoders.bean(LabeledPoint.class) > --- > > Key: SPARK-21482 > URL: https://issues.apache.org/jira/browse/SPARK-21482 > Project: Spark > Issue Type: Improvement > Components: ML >Affects Versions: 2.1.0 >Reporter: Aseem Bansal >Priority: Minor > > The LabeledPoint class is currently not bean-compliant as per spark > https://spark.apache.org/docs/2.1.0/api/scala/index.html#org.apache.spark.ml.feature.LabeledPoint > This makes it impossible to create a LabeledPoint via a dataset.tranform. It > should be made bean-compliant so it can be used. -- This message was sent by Atlassian JIRA (v6.4.14#64029) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-21482) Make LabeledPoint bean-compliant so it can be used in Encoders.bean(LabeledPoint.class)
[ https://issues.apache.org/jira/browse/SPARK-21482?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16094282#comment-16094282 ] Sean Owen commented on SPARK-21482: --- Does it need to be bean compliant? Encoders don't have to act on beans. > Make LabeledPoint bean-compliant so it can be used in > Encoders.bean(LabeledPoint.class) > --- > > Key: SPARK-21482 > URL: https://issues.apache.org/jira/browse/SPARK-21482 > Project: Spark > Issue Type: Improvement > Components: ML >Affects Versions: 2.1.0 >Reporter: Aseem Bansal > > The LabeledPoint class is currently not bean-compliant as per spark > https://spark.apache.org/docs/2.1.0/api/scala/index.html#org.apache.spark.ml.feature.LabeledPoint > This makes it impossible to create a LabeledPoint via a dataset.tranform. It > should be made bean-compliant so it can be used. -- This message was sent by Atlassian JIRA (v6.4.14#64029) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org