Shivaram Venkataraman created SPARK-6819:
--------------------------------------------
Summary: Support nested types in SparkR DataFrame
Key: SPARK-6819
URL: https://issues.apache.org/jira/browse/SPARK-6819
Project: Spark
Issue Type: New Feature
Components: SparkR, SQL
Reporter: Shivaram Venkataraman
ArrayType, MapType and StructureType
We can infer the correct schema for them, but the serialization can not handle
them well.
>From Davies in https://sparkr.atlassian.net/browse/SPARKR-230
ArrayType could be c("ab", "ba"), we will serialize it as character. We does
not support deserialize env in R (serialize Map[] in Scala). So all the three
do not work.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]