[ https://issues.apache.org/jira/browse/SPARK-5288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14295765#comment-14295765 ]
Xiangrui Meng commented on SPARK-5288: -------------------------------------- +1 on the use case [~prudenko] metnioned. [~rxin] If we only keep leaf types, we should provide methods to validate a group of types, e.g., whether a type could be casted to Double. > Stabilize Spark SQL data type API followup > ------------------------------------------- > > Key: SPARK-5288 > URL: https://issues.apache.org/jira/browse/SPARK-5288 > Project: Spark > Issue Type: Sub-task > Components: SQL > Reporter: Yin Huai > Assignee: Yin Huai > > Several issues we need to address before release 1.3 > * Do we want to make all classes in > org.apache.spark.sql.types.dataTypes.scala public? Seems we do not need to > make those abstract classes public. > * Seems NativeType is not a very clear and useful concept. Should we just > remove it? > * We need to Stabilize the type hierarchy of our data types. Seems StringType > and Decimal Type should not be primitive types. -- This message was sent by Atlassian JIRA (v6.3.4#6332) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org