Cheng Lian created SPARK-12323:
----------------------------------
Summary: Don't assign default value for non-nullable columns of a
Dataset
Key: SPARK-12323
URL: https://issues.apache.org/jira/browse/SPARK-12323
Project: Spark
Issue Type: Bug
Components: SQL
Affects Versions: 1.6.0, 2.0.0
Reporter: Cheng Lian
Assignee: Cheng Lian
For a field of a Dataset, if it's specified as non-nullable in the schema of
the Dataset, we shouldn't assign default value for it if input data contain
null. Instead, a runtime exception with nice error message should be thrown,
and ask the user to use {{Option}} or nullable types (e.g.,
{{java.lang.Integer}} instead of {{scala.Int}}).
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
