[
https://issues.apache.org/jira/browse/HUDI-9251?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Shuo Cheng updated HUDI-9251:
-----------------------------
Description:
* Ordering value for DeleteRecord in log files should be engine-agnostic, e.g.,
Java type or Avro type., so that log files can be merge-read cross engines.
* When Spark writing log files with engine specific record (HoodieSparkRecord),
ordering value is directly extract from InternalRow.
(HoodieSparkRecord#getOrderingValue), the type maybe spark specific, e.g.,
`org.apache.spark.sql.types.Decimal`.
!screenshot-1.png!
> Type of ordering value for DeleteRecord is engine type during spark writing
> log files
> -------------------------------------------------------------------------------------
>
> Key: HUDI-9251
> URL: https://issues.apache.org/jira/browse/HUDI-9251
> Project: Apache Hudi
> Issue Type: Bug
> Reporter: Shuo Cheng
> Priority: Major
> Attachments: screenshot-1.png
>
>
> * Ordering value for DeleteRecord in log files should be engine-agnostic,
> e.g., Java type or Avro type., so that log files can be merge-read cross
> engines.
> * When Spark writing log files with engine specific record
> (HoodieSparkRecord), ordering value is directly extract from InternalRow.
> (HoodieSparkRecord#getOrderingValue), the type maybe spark specific, e.g.,
> `org.apache.spark.sql.types.Decimal`.
> !screenshot-1.png!
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
