[
https://issues.apache.org/jira/browse/SPARK-19177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15821986#comment-15821986
]
Shivaram Venkataraman commented on SPARK-19177:
-----------------------------------------------
Thanks for the example - this is very useful. Just to confirm the problem here
is in dealing with schema objects and specifically being able to append and /
or optionally mutate the schema ? I'll update the JIRA title appropriately and
we'll work on a fix for this.
> SparkR Data Frame operation between columns elements
> ----------------------------------------------------
>
> Key: SPARK-19177
> URL: https://issues.apache.org/jira/browse/SPARK-19177
> Project: Spark
> Issue Type: Question
> Components: SparkR
> Affects Versions: 2.0.2
> Reporter: Vicente Masip
> Priority: Minor
> Labels: schema, sparkR, struct
>
> I have commented this in other thread, but I think it can be important to
> clarify that:
> What happen when you are working with 50 columns and gapply? Do I rewrite 50
> columns scheme with it's new column from gapply operation? I think there is
> no alternative because structFields cannot be appended to structType. Any
> suggestions?
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]