chris-twiner commented on code in PR #50023:
URL: https://github.com/apache/spark/pull/50023#discussion_r1969966712
##########
sql/api/src/main/scala/org/apache/spark/sql/catalyst/encoders/AgnosticEncoder.scala:
##########
@@ -286,5 +286,6 @@ object AgnosticEncoders {
override def dataType: DataType = transformed.dataType
override def schema: StructType = transformed.schema
override def isStruct: Boolean = transformed.isStruct
+ override def nullable: Boolean = transformed.nullable
Review Comment:
Given this is only for Spark 4 I'd be happier adding nullable as a param,
this would allow signalling to the builders if the codec can handle nulls or
not for the general case. Let me know if that's an option and I'll do a full
suite of testing again.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
