[
https://issues.apache.org/jira/browse/SPARK-12823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16958841#comment-16958841
]
David Szakallas commented on SPARK-12823:
-
Since the helper library [~gbarna] created is very
[
https://issues.apache.org/jira/browse/SPARK-12823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16844883#comment-16844883
]
Hyukjin Kwon commented on SPARK-12823:
--
nope, this JIRA targets EOL release which is difficult to
[
https://issues.apache.org/jira/browse/SPARK-12823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16844802#comment-16844802
]
Simeon H.K. Fitch commented on SPARK-12823:
---
Hi [~hyukjin.kwon], is there a commit associated
[
https://issues.apache.org/jira/browse/SPARK-12823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1642#comment-1642
]
todesking commented on SPARK-12823:
---
I understand currently Spark not supported struct/array types in
[
https://issues.apache.org/jira/browse/SPARK-12823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16422189#comment-16422189
]
Simeon H.K. Fitch commented on SPARK-12823:
---
[~gbarna]Nice! Thanks for sharing!
> Cannot
[
https://issues.apache.org/jira/browse/SPARK-12823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16421700#comment-16421700
]
Gabor Barna commented on SPARK-12823:
-
Hi,
I created a library to address this issue:
[
https://issues.apache.org/jira/browse/SPARK-12823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16173702#comment-16173702
]
Simeon H.K. Fitch commented on SPARK-12823:
---
As a coda, it's interesting to note that you can
[
https://issues.apache.org/jira/browse/SPARK-12823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16171870#comment-16171870
]
Takeshi Yamamuro commented on SPARK-12823:
--
what do u think when is the good timing to take on
[
https://issues.apache.org/jira/browse/SPARK-12823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16171825#comment-16171825
]
Wenchen Fan commented on SPARK-12823:
-
Ah now I understand what you want. Even though the data is
[
https://issues.apache.org/jira/browse/SPARK-12823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16171735#comment-16171735
]
Simeon H.K. Fitch commented on SPARK-12823:
---
[~cloud_fan] If the intent is to *not* support
[
https://issues.apache.org/jira/browse/SPARK-12823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16171679#comment-16171679
]
Wenchen Fan commented on SPARK-12823:
-
UDF is kind of a SQL terminology so it only works with Spark
[
https://issues.apache.org/jira/browse/SPARK-12823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16171668#comment-16171668
]
Simeon H.K. Fitch commented on SPARK-12823:
---
Here is a combined, runnable example:
[
https://issues.apache.org/jira/browse/SPARK-12823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16171627#comment-16171627
]
Simeon H.K. Fitch commented on SPARK-12823:
---
When you say "Row", do you mean
[
https://issues.apache.org/jira/browse/SPARK-12823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16171019#comment-16171019
]
Takeshi Yamamuro commented on SPARK-12823:
--
As wenchen suggested, why don't you use `Row` as an
[
https://issues.apache.org/jira/browse/SPARK-12823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16170540#comment-16170540
]
Simeon H.K. Fitch commented on SPARK-12823:
---
My suspicion is that the bug is
[
https://issues.apache.org/jira/browse/SPARK-12823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16170511#comment-16170511
]
Simeon H.K. Fitch commented on SPARK-12823:
---
Unfortunately, using a `TypedColumn` doesn't help
[
https://issues.apache.org/jira/browse/SPARK-12823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15829975#comment-15829975
]
Wenchen Fan commented on SPARK-12823:
-
Have you tried `SparkSession.udf.register("name", (row: Row)
[
https://issues.apache.org/jira/browse/SPARK-12823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15829810#comment-15829810
]
Wenchen Fan commented on SPARK-12823:
-
When your data are loaded into `DataFrame`, the type
[
https://issues.apache.org/jira/browse/SPARK-12823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15826239#comment-15826239
]
Takeshi Yamamuro commented on SPARK-12823:
--
This ticket is similar to SPARK-18884, so I'll take
[
https://issues.apache.org/jira/browse/SPARK-12823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15108689#comment-15108689
]
Frank Rosner commented on SPARK-12823:
--
Ok :( :D
> Cannot create UDF with StructType input
>
[
https://issues.apache.org/jira/browse/SPARK-12823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15109034#comment-15109034
]
Frank Rosner commented on SPARK-12823:
--
Ok :( :D
> Cannot create UDF with StructType input
>
[
https://issues.apache.org/jira/browse/SPARK-12823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15108342#comment-15108342
]
Frank Rosner commented on SPARK-12823:
--
Any thoughts on this one [~srowen]?
> Cannot create UDF
[
https://issues.apache.org/jira/browse/SPARK-12823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15108390#comment-15108390
]
Sean Owen commented on SPARK-12823:
---
This is honestly outside my area... I don't tend to touch SQL or
23 matches
Mail list logo
