Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/15780 Some more thoughts: in `ExpressionEncoder` we get the schema of encoder by ``` val schema = ScalaReflection.schemaFor[T] match { case ScalaReflection.Schema(s: StructType, _) => s case ScalaReflection.Schema(dt, nullable) => new StructType().add("value", dt, nullable) } ``` now we fix the nullability of the serializer expressions, can we just use `val schema = serializer.schema` and see if tests can pass?
--- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- --------------------------------------------------------------------- To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org