I have found why the exception is raised.
I have defined a JSON schema, using org.apache.spark.sql.types.StructType,
that expects this kind of record :
/{
"request": {
"user": {
"id": 123
}
}
}/
There's a bad record in my dataset, that defines field "user" as an array,
instead of a JSON object :
/{
"request": {
"user": []
}
}/
I have created the following issue :
https://issues.apache.org/jira/browse/SPARK-13719
--
View this message in context:
http://apache-spark-user-list.1001560.n3.nabble.com/org-apache-spark-sql-types-GenericArrayData-cannot-be-cast-to-org-apache-spark-sql-catalyst-Internalw-tp26377p26417.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.
---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscr...@spark.apache.org
For additional commands, e-mail: user-h...@spark.apache.org
