[
https://issues.apache.org/jira/browse/SPARK-18789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15929272#comment-15929272
]
Hyukjin Kwon commented on SPARK-18789:
--
Do you mind if I ask a simple code for this? Pseudocode is
[
https://issues.apache.org/jira/browse/SPARK-18789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15929259#comment-15929259
]
Harish commented on SPARK-18789:
When you create the DF (dynamic) withough knowing the type of the column
[
https://issues.apache.org/jira/browse/SPARK-18789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15929084#comment-15929084
]
Hyukjin Kwon commented on SPARK-18789:
--
It seems it goes failed in schema inference.
{code}
>>>
[
https://issues.apache.org/jira/browse/SPARK-18789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15928926#comment-15928926
]
Harish commented on SPARK-18789:
In your example you are defining the schema first and then loading the
[
https://issues.apache.org/jira/browse/SPARK-18789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15928780#comment-15928780
]
Hyukjin Kwon commented on SPARK-18789:
--
Hm, do you mind if I ask a reproducer?
{code}
from
[
https://issues.apache.org/jira/browse/SPARK-18789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15928738#comment-15928738
]
Hyukjin Kwon commented on SPARK-18789:
--
Doh, I am sorry. Let me try to test again and will open. I
[
https://issues.apache.org/jira/browse/SPARK-18789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15928213#comment-15928213
]
Eugen Prokhorenko commented on SPARK-18789:
---
Just wanted to mention that initial problem
[
https://issues.apache.org/jira/browse/SPARK-18789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15897791#comment-15897791
]
Eugen Prokhorenko commented on SPARK-18789:
---
I've added a python script (instead of a Scala app
[
https://issues.apache.org/jira/browse/SPARK-18789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15829906#comment-15829906
]
Eugen Prokhorenko commented on SPARK-18789:
---
Hello,
I would want to investigate this issue
