Sagar Sumit created HUDI-9213:
---------------------------------
Summary: While upgrading from 0.x to 1.0 with RLI, compaction fails
Key: HUDI-9213
URL: https://issues.apache.org/jira/browse/HUDI-9213
Project: Apache Hudi
Issue Type: Bug
Reporter: Sagar Sumit
Fix For: 1.0.2
With RLI, upgrade is failing during compaction. The error is around
{{position}} field. Error is occurring in
{{org.apache.hudi.metadata.MetadataPartitionType#constructMetadataPayload}}
because we are checking for position field directly. Field exists should
suffice there.
{code:java}
25/03/22 15:42:34 ERROR AbstractHoodieLogRecordScanner: Got exception when
reading log file
org.apache.hudi.exception.HoodieException: Unable to instantiate payload class
at
org.apache.hudi.common.util.HoodieRecordUtils.loadPayload(HoodieRecordUtils.java:114)
at
org.apache.hudi.common.util.SpillableMapUtils.convertToHoodieRecordPayload(SpillableMapUtils.java:155)
at
org.apache.hudi.avro.HoodieAvroUtils.createHoodieRecordFromAvro(HoodieAvroUtils.java:1384)
at
org.apache.hudi.common.model.HoodieAvroIndexedRecord.wrapIntoHoodieRecordPayloadWithParams(HoodieAvroIndexedRecord.java:168)
at
org.apache.hudi.common.table.log.AbstractHoodieLogRecordScanner.processDataBlock(AbstractHoodieLogRecordScanner.java:637)
at
org.apache.hudi.common.table.log.AbstractHoodieLogRecordScanner.processQueuedBlocksForInstant(AbstractHoodieLogRecordScanner.java:677)
at
org.apache.hudi.common.table.log.AbstractHoodieLogRecordScanner.scanInternalV1(AbstractHoodieLogRecordScanner.java:380)
{code}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)