[
https://issues.apache.org/jira/browse/SPARK-15505?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15840227#comment-15840227
]
Jorge Machado commented on SPARK-15505:
---------------------------------------
Sometimes you read from a database that has an array in it, at least was in my
case. But fell free to reject it.
> Explode nested Array in DF Column into Multiple Columns
> --------------------------------------------------------
>
> Key: SPARK-15505
> URL: https://issues.apache.org/jira/browse/SPARK-15505
> Project: Spark
> Issue Type: Improvement
> Components: Spark Core
> Affects Versions: 1.6.1
> Reporter: Jorge Machado
> Priority: Minor
>
> At the moment if we have a DF like this :
> {noformat}
> +------+---------+
> | Col1 | Col2 |
> +------+---------+
> | 1 |[2, 3, 4]|
> | 1 |[2, 3, 4]|
> +------+---------+
> {noformat}
> There is no way to directly transform it into :
> {noformat}
> +------+------+------+------+
> | Col1 | Col2 | Col3 | Col4 |
> +------+------+------+------+
> | 1 | 2 | 3 | 4 |
> | 1 | 2 | 3 | 4 |
> +------+------+------+------+
> {noformat}
> I think this should be easy to implement
> More infos here :
> http://stackoverflow.com/questions/37391241/explode-spark-columns/37392793#37392793
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
