[jira] [Commented] (SPARK-31074) Avro serializer should not fail when a nullable Spark field is written to a non-null Avro column

[ https://issues.apache.org/jira/browse/SPARK-31074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17059823#comment-17059823 ] Kyrill Alyoshin commented on SPARK-31074: - Hmm... If you can't reproduce it, then it is likely

[jira] [Comment Edited] (SPARK-31074) Avro serializer should not fail when a nullable Spark field is written to a non-null Avro column

[ https://issues.apache.org/jira/browse/SPARK-31074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17057505#comment-17057505 ] Kyrill Alyoshin edited comment on SPARK-31074 at 3/12/20, 1:01 AM: ---

[jira] [Comment Edited] (SPARK-31074) Avro serializer should not fail when a nullable Spark field is written to a non-null Avro column

[ https://issues.apache.org/jira/browse/SPARK-31074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17057505#comment-17057505 ] Kyrill Alyoshin edited comment on SPARK-31074 at 3/12/20, 1:01 AM: ---

[jira] [Commented] (SPARK-31074) Avro serializer should not fail when a nullable Spark field is written to a non-null Avro column

[ https://issues.apache.org/jira/browse/SPARK-31074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17057505#comment-17057505 ] Kyrill Alyoshin commented on SPARK-31074: - Here you go. Avro schema:   {code:java} { "type":

[jira] [Commented] (SPARK-31074) Avro serializer should not fail when a nullable Spark field is written to a non-null Avro column

[ https://issues.apache.org/jira/browse/SPARK-31074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17056972#comment-17056972 ] Kyrill Alyoshin commented on SPARK-31074: - Yes, # Create a simple Avro schema file with 2

[jira] [Comment Edited] (SPARK-31074) Avro serializer should not fail when a nullable Spark field is written to a non-null Avro column

[ https://issues.apache.org/jira/browse/SPARK-31074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17054859#comment-17054859 ] Kyrill Alyoshin edited comment on SPARK-31074 at 3/9/20, 11:57 AM: ---

[jira] [Commented] (SPARK-31074) Avro serializer should not fail when a nullable Spark field is written to a non-null Avro column

[ https://issues.apache.org/jira/browse/SPARK-31074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17054859#comment-17054859 ] Kyrill Alyoshin commented on SPARK-31074: - The first issue was about controlling _nullability_

[jira] [Commented] (SPARK-31071) Spark Encoders.bean() should allow marking non-null fields in its Spark schema

[ https://issues.apache.org/jira/browse/SPARK-31071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17054521#comment-17054521 ] Kyrill Alyoshin commented on SPARK-31071: - _javax.annotation.Nonnull_ - seems like a good

[jira] [Created] (SPARK-31074) Avro serializer should not fail when a nullable Spark field is written to a non-null Avro column

Kyrill Alyoshin created SPARK-31074: --- Summary: Avro serializer should not fail when a nullable Spark field is written to a non-null Avro column Key: SPARK-31074 URL:

[jira] [Updated] (SPARK-31071) Spark Encoders.bean() should allow marking non-null fields in its Spark schema

[ https://issues.apache.org/jira/browse/SPARK-31071?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kyrill Alyoshin updated SPARK-31071: Summary: Spark Encoders.bean() should allow marking non-null fields in its Spark schema

[jira] [Created] (SPARK-31071) Spark Encoders.bean() should allow setting non-null fields in its Spark schema

Kyrill Alyoshin created SPARK-31071: --- Summary: Spark Encoders.bean() should allow setting non-null fields in its Spark schema Key: SPARK-31071 URL: https://issues.apache.org/jira/browse/SPARK-31071