Github user JoshRosen commented on the pull request:
https://github.com/apache/spark/pull/6222#issuecomment-105082512
It looks like we have some undefined behavior that may be very difficult to
preserve. If you declare a column to have some primitive type, like float,
then proceed to pass in some value of an arbitrary different type, this won't
cause any errors as long as you don't perform any operations on that column
which rely on it being a particular type. In a nutshell, the schema's type for
a column seems to be irrelevant if that column is just passed through
unmodified / unaccessed as part of query processing.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
