[
https://issues.apache.org/jira/browse/SPARK-11319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15274737#comment-15274737
]
Yin Huai commented on SPARK-11319:
--
That PR should fix this issue. In python's createDataFrame, before
[
https://issues.apache.org/jira/browse/SPARK-11319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15274728#comment-15274728
]
Nicholas Chammas commented on SPARK-11319:
--
[~marmbrus] / [~yhuai] - Does SPARK-13740 resolve
[
https://issues.apache.org/jira/browse/SPARK-11319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15199743#comment-15199743
]
François Prunier commented on SPARK-11319:
--
Hi,
I created a PR to enhance the documentation:
[
https://issues.apache.org/jira/browse/SPARK-11319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15199741#comment-15199741
]
Apache Spark commented on SPARK-11319:
--
User 'francoisprunier' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-11319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15201308#comment-15201308
]
François Prunier commented on SPARK-11319:
--
Hi [~yhuai],
I'm not familiar with python, I
[
https://issues.apache.org/jira/browse/SPARK-11319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15199967#comment-15199967
]
Yin Huai commented on SPARK-11319:
--
Thank you for the doc update. We recently added a check to make sure
[
https://issues.apache.org/jira/browse/SPARK-11319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15014098#comment-15014098
]
Harry Brundage commented on SPARK-11319:
Forgive my frankness but that is ridiculous. This means
[
https://issues.apache.org/jira/browse/SPARK-11319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15014360#comment-15014360
]
Yin Huai commented on SPARK-11319:
--
For those data sources, the nullable field is always true unless you
[
https://issues.apache.org/jira/browse/SPARK-11319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15014405#comment-15014405
]
Harry Brundage commented on SPARK-11319:
Why force all users everywhere to do a pass over the
[
https://issues.apache.org/jira/browse/SPARK-11319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15014414#comment-15014414
]
Harry Brundage commented on SPARK-11319:
I also don't think that "JSON data is likely to have
[
https://issues.apache.org/jira/browse/SPARK-11319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15014678#comment-15014678
]
Michael Armbrust commented on SPARK-11319:
--
bq. It doesn't sound much like a hint to me. In my
[
https://issues.apache.org/jira/browse/SPARK-11319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15014711#comment-15014711
]
Harry Brundage commented on SPARK-11319:
Oh I forgot to mention I could imagine us settling on a
[
https://issues.apache.org/jira/browse/SPARK-11319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15014657#comment-15014657
]
Kevin Cox commented on SPARK-11319:
---
{quote}
First of all, lets talk about nullability in the context
[
https://issues.apache.org/jira/browse/SPARK-11319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15014705#comment-15014705
]
Harry Brundage commented on SPARK-11319:
bq. First of all, lets talk about nullability in the
[
https://issues.apache.org/jira/browse/SPARK-11319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15014535#comment-15014535
]
Michael Armbrust commented on SPARK-11319:
--
Okay, the tone here is quickly veering away from
[
https://issues.apache.org/jira/browse/SPARK-11319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15012355#comment-15012355
]
Yin Huai commented on SPARK-11319:
--
For now, the provider of the data needs to make sure values do not
[
https://issues.apache.org/jira/browse/SPARK-11319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15007220#comment-15007220
]
Daniel Jalova commented on SPARK-11319:
---
Seems that this is possible in the Scala API too.
>
[
https://issues.apache.org/jira/browse/SPARK-11319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14997100#comment-14997100
]
Daniel Jalova commented on SPARK-11319:
---
I would like to work on this.
> PySpark silently Accepts
[
https://issues.apache.org/jira/browse/SPARK-11319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14974579#comment-14974579
]
Kevin Cox commented on SPARK-11319:
---
Furthermore it appears that some functions are "optimized" based
19 matches
Mail list logo
