Github user liancheng commented on the pull request:
https://github.com/apache/spark/pull/4826#issuecomment-76715599
@yhuai @marmbrus This PR basically makes both JSON and Parquet data sources
always nullable. I agree that this makes most common cases more robust. Should
we take a more aggressive step and just remove
`nullable`/`containsNull`/`valueContainsNull` fields and assume all data
sources are always nullable? Up until now, I can only see troubles rather than
any benefits brought by nullability. Of course, this is out of the scope of
this PR.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
