gengliangwang commented on issue #24805: [SPARK-27798][SQL] from_avro shouldn't produces same value when converted to local relation URL: https://github.com/apache/spark/pull/24805#issuecomment-499548395 > Option 2 is chose because previously ConvertToLocalRelation also creates new rows, this InterpretedMutableProjection + copy() shoudn't bring too much performance penalty. ConvertToLocalRelation should be arguably less critical, compared with AvroDeserializer. @viirya Thanks for the fix. +1 with using Option #2
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
