wombatu-kun commented on issue #20365: URL: https://github.com/apache/hudi/issues/20365#issuecomment-6211937513
The same mismatch exists on table version 10 with the Avro record type. Native log compaction (`FileGroupReaderBasedNativeLogAppendHandle`) reads deletes back through the Spark reader context and hands a Spark `Decimal` ordering value to the Avro delete log writer, which throws `ClassCastException: class org.apache.spark.sql.types.Decimal cannot be cast to class org.apache.avro.generic.GenericFixed`. `HoodieAppendHandle` only marks the record as failed, the log compaction commits, and the delete is lost, so a later update with an older ordering value brings the row back. #20366 now covers this case too. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
