Yin Huai created SPARK-2908:
-------------------------------
Summary: JsonRDD.nullTypeToStringType does not convert all
NullType to StringType
Key: SPARK-2908
URL: https://issues.apache.org/jira/browse/SPARK-2908
Project: Spark
Issue Type: Bug
Components: SQL
Reporter: Yin Huai
Failed on
{code}
val schemaRDD = jsonRDD(sparkContext.parallelize(Seq("""{"record":
[{"children": null}]}""")))
{code}
{code}
schemaRDD.schema
StructType(ArrayBuffer(StructField(record,ArrayType(StructType(ArrayBuffer(StructField(children,NullType,true))),false),true)))
{code}
You can see the children field is still NullType.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
