[jira] [Commented] (SPARK-24269) Infer nullability rather than declaring all columns as nullable

[ https://issues.apache.org/jira/browse/SPARK-24269?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16484071#comment-16484071 ] Simeon Simeonov commented on SPARK-24269: - There are many reasons why correct nullability

[jira] [Commented] (SPARK-24269) Infer nullability rather than declaring all columns as nullable

[ https://issues.apache.org/jira/browse/SPARK-24269?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16482156#comment-16482156 ] Teng Peng commented on SPARK-24269: --- Yes, I understand this rationale too. However, I am inclined to a

[jira] [Commented] (SPARK-24269) Infer nullability rather than declaring all columns as nullable

[ https://issues.apache.org/jira/browse/SPARK-24269?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16482148#comment-16482148 ] Hyukjin Kwon commented on SPARK-24269: -- I can at least see the reason. If data doesn't contain null,

[jira] [Commented] (SPARK-24269) Infer nullability rather than declaring all columns as nullable

[ https://issues.apache.org/jira/browse/SPARK-24269?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16481812#comment-16481812 ] Teng Peng commented on SPARK-24269: --- Does it make sense to infer nullability from JSON and CSV?  >

[jira] [Commented] (SPARK-24269) Infer nullability rather than declaring all columns as nullable

[ https://issues.apache.org/jira/browse/SPARK-24269?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16475185#comment-16475185 ] Hyukjin Kwon commented on SPARK-24269: -- BTW, don't we already force the given schema to nullable