rahil-c commented on code in PR #17573: URL: https://github.com/apache/hudi/pull/17573#discussion_r2627876904
########## hudi-spark-datasource/hudi-spark3.3.x/src/main/scala/org/apache/spark/sql/avro/AvroDeserializerInternal.scala: ########## @@ -17,13 +17,15 @@ package org.apache.spark.sql.avro Review Comment: I believe this will unfortunately have to still be on the spark path as I see in this class usage of certain spark types such as `TimeStampNTZ` which is private in spark 3.3. https://github.com/apache/hudi/blob/master/hudi-spark-datasource/hudi-spark3.3.x/src/main/scala/org/apache/spark/sql/avro/AvroDeserializer.scala#L152 Its basically doing the same trick i believe as what we saw in the spark schema converter pr: https://github.com/apache/hudi/pull/17475#discussion_r2606937790 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
