Github user gengliangwang commented on a diff in the pull request:
https://github.com/apache/spark/pull/21984#discussion_r207724930
--- Diff:
external/avro/src/main/scala/org/apache/spark/sql/avro/AvroSerializer.scala ---
@@ -92,7 +92,7 @@ class AvroSerializer(rootCatalystType: DataType,
rootAvroType: Schema, nullable:
case BinaryType =>
(getter, ordinal) => ByteBuffer.wrap(getter.getBinary(ordinal))
case DateType =>
- (getter, ordinal) => getter.getInt(ordinal) *
DateTimeUtils.MILLIS_PER_DAY
+ (getter, ordinal) => getter.getInt(ordinal)
--- End diff --
I don't think it is behavior change. The only concern is that the Avro file
with date type column is written with this built-in package, and read by third
party one with user specify schema. The case should be very trivial and we can
ignore that.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
