Asif Hussain Shahid created SPARK-22192:
-------------------------------------------
Summary: An RDD of nested POJO objects cannot be converted into a
DataFrame using SQLContext.createDataFrame API
Key: SPARK-22192
URL: https://issues.apache.org/jira/browse/SPARK-22192
Project: Spark
Issue Type: Bug
Components: SQL
Affects Versions: 2.2.0
Environment: Independent of OS / platform
Reporter: Asif Hussain Shahid
Priority: Minor
If an RDD contains nested POJO objects, then SQLContext.createDataFrame(RDD,
Class) api only handles the top level POJO object. It throws ScalaMatchError
exception when handling the nested POJO object as the code does not recursively
handle the nested POJOs.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
