YanTang Zhai created SPARK-4676:
-----------------------------------
Summary: JavaSchemaRDD.schema may throw NullType MatchError if sql
has null
Key: SPARK-4676
URL: https://issues.apache.org/jira/browse/SPARK-4676
Project: Spark
Issue Type: Bug
Components: SQL
Reporter: YanTang Zhai
val jsc = new org.apache.spark.api.java.JavaSparkContext(sc)
val jhc = new org.apache.spark.sql.hive.api.java.JavaHiveContext(jsc)
val nrdd = jhc.hql("select null from spark_test.for_test")
println(nrdd.schema)
Then the error is thrown as follows:
scala.MatchError: NullType (of class
org.apache.spark.sql.catalyst.types.NullType$)
at
org.apache.spark.sql.types.util.DataTypeConversions$.asJavaDataType(DataTypeConversions.scala:43)
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
