[ https://issues.apache.org/jira/browse/SPARK-7768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15807248#comment-15807248 ]
Liang-Chi Hsieh commented on SPARK-7768: ---------------------------------------- Hi Randall, With the {{UDTRegistration}} added since 2.0, we already can make UDT work with a class of an unmodified third-party library. You can define the user defined type ({{UserDefinedType}}) for the class from third-party library. Then you can register the defined type with the third-party class to {{UDTRegistration}}: {code} class ThirdPartyClassUDT extends UserDefinedType[ThirdPartyClass] { ... } UDTRegistration.register(classOf[ThirdPartyClass].getName, classOf[ThirdPartyClassUDT].getName) {code} Unfortunately, {{UDTRegistration}} is still in private. I hope we can make it public soon in this change. > Make user-defined type (UDT) API public > --------------------------------------- > > Key: SPARK-7768 > URL: https://issues.apache.org/jira/browse/SPARK-7768 > Project: Spark > Issue Type: New Feature > Components: SQL > Reporter: Xiangrui Meng > Priority: Critical > > As the demand for UDTs increases beyond sparse/dense vectors in MLlib, it > would be nice to make the UDT API public in 1.5. -- This message was sent by Atlassian JIRA (v6.3.4#6332) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org