Repository: spark Updated Branches: refs/heads/master eebc8c1c9 -> b7836492b
[SPARK-14155][SQL] Hide UserDefinedType interface in Spark 2.0 ## What changes were proposed in this pull request? UserDefinedType is a developer API in Spark 1.x. With very high probability we will create a new API for user-defined type that also works well with column batches as well as encoders (datasets). In Spark 2.0, let's make `UserDefinedType` `private[spark]` first. ## How was this patch tested? Existing unit tests. Author: Reynold Xin <[email protected]> Closes #11955 from rxin/SPARK-14155. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/b7836492 Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/b7836492 Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/b7836492 Branch: refs/heads/master Commit: b7836492bb0b5b430539d2bfa20bcc32e3fe3504 Parents: eebc8c1 Author: Reynold Xin <[email protected]> Authored: Mon Mar 28 16:26:32 2016 -0700 Committer: Reynold Xin <[email protected]> Committed: Mon Mar 28 16:26:32 2016 -0700 ---------------------------------------------------------------------- .../scala/org/apache/spark/sql/types/UserDefinedType.scala | 6 ++++-- 1 file changed, 4 insertions(+), 2 deletions(-) ---------------------------------------------------------------------- http://git-wip-us.apache.org/repos/asf/spark/blob/b7836492/sql/catalyst/src/main/scala/org/apache/spark/sql/types/UserDefinedType.scala ---------------------------------------------------------------------- diff --git a/sql/catalyst/src/main/scala/org/apache/spark/sql/types/UserDefinedType.scala b/sql/catalyst/src/main/scala/org/apache/spark/sql/types/UserDefinedType.scala index dabf9a2..fb7251d 100644 --- a/sql/catalyst/src/main/scala/org/apache/spark/sql/types/UserDefinedType.scala +++ b/sql/catalyst/src/main/scala/org/apache/spark/sql/types/UserDefinedType.scala @@ -23,7 +23,6 @@ import org.json4s.JsonDSL._ import org.apache.spark.annotation.DeveloperApi /** - * ::DeveloperApi:: * The data type for User Defined Types (UDTs). * * This interface allows a user to make their own classes more interoperable with SparkSQL; @@ -35,8 +34,11 @@ import org.apache.spark.annotation.DeveloperApi * * The conversion via `serialize` occurs when instantiating a `DataFrame` from another RDD. * The conversion via `deserialize` occurs when reading from a `DataFrame`. + * + * Note: This was previously a developer API in Spark 1.x. We are making this private in Spark 2.0 + * because we will very likely create a new version of this that works better with Datasets. */ -@DeveloperApi +private[spark] abstract class UserDefinedType[UserType >: Null] extends DataType with Serializable { /** Underlying storage type for this UDT */ --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
