[
https://issues.apache.org/jira/browse/SPARK-15505?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15839365#comment-15839365
]
Jorge Machado commented on SPARK-15505:
---------------------------------------
[~hyukjin.kwon] you don't really always know if you have two our five elements
in the second column...
> Explode nested Array in DF Column into Multiple Columns
> --------------------------------------------------------
>
> Key: SPARK-15505
> URL: https://issues.apache.org/jira/browse/SPARK-15505
> Project: Spark
> Issue Type: Improvement
> Components: Spark Core
> Affects Versions: 1.6.1
> Reporter: Jorge Machado
> Priority: Minor
>
> At the moment if we have a DF like this :
> {noformat}
> +------+---------+
> | Col1 | Col2 |
> +------+---------+
> | 1 |[2, 3, 4]|
> | 1 |[2, 3, 4]|
> +------+---------+
> {noformat}
> There is no way to directly transform it into :
> {noformat}
> +------+------+------+------+
> | Col1 | Col2 | Col3 | Col4 |
> +------+------+------+------+
> | 1 | 2 | 3 | 4 |
> | 1 | 2 | 3 | 4 |
> +------+------+------+------+
> {noformat}
> I think this should be easy to implement
> More infos here :
> http://stackoverflow.com/questions/37391241/explode-spark-columns/37392793#37392793
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
