hudi-bot opened a new issue, #16331:
URL: https://github.com/apache/hudi/issues/16331
{code:java}
2023-12-06 14:32:16 [ INFO]
org.apache.hudi.common.table.log.HoodieLogFormatWriter :
HoodieLogFile{pathStr='file:/tmp/t2/.hoodie/archived/.commits_.archive.1_1-0-1',
fileLen=0} does not exist. Create a new file
2023-12-06 14:32:16 [ERROR] org.apache.hudi.client.HoodieTimelineArchiver
: Failed to archive commits, .commit file: 00000000000001.deltacommit
java.lang.NullPointerException: null of string of map of union in field
extraMetadata of org.apache.hudi.avro.model.HoodieCommitMetadata of union in
field hoodieCommitMetadata of org.apache.hudi.avro.model.HoodieArchivedMetaEntry
at
org.apache.avro.generic.GenericDatumWriter.npe(GenericDatumWriter.java:184)
~[avro-1.10.0.jar:1.10.0]
at
org.apache.avro.generic.GenericDatumWriter.writeWithoutConversion(GenericDatumWriter.java:178)
~[avro-1.10.0.jar:1.10.0]
at
org.apache.avro.generic.GenericDatumWriter.write(GenericDatumWriter.java:83)
~[avro-1.10.0.jar:1.10.0]
at
org.apache.avro.generic.GenericDatumWriter.write(GenericDatumWriter.java:73)
~[avro-1.10.0.jar:1.10.0]
at
org.apache.hudi.common.table.log.block.HoodieAvroDataBlock.serializeRecords(HoodieAvroDataBlock.java:119)
~[hudi-common-0.12.2.jar:0.12.2]
at
org.apache.hudi.common.table.log.block.HoodieDataBlock.getContentBytes(HoodieDataBlock.java:131)
~[hudi-common-0.12.2.jar:0.12.2]
at
org.apache.hudi.common.table.log.HoodieLogFormatWriter.appendBlocks(HoodieLogFormatWriter.java:158)
~[hudi-common-0.12.2.jar:0.12.2]
at
org.apache.hudi.common.table.log.HoodieLogFormatWriter.appendBlock(HoodieLogFormatWriter.java:135)
~[hudi-common-0.12.2.jar:0.12.2]
at
org.apache.hudi.client.HoodieTimelineArchiver.writeToFile(HoodieTimelineArchiver.java:671)
~[hudi-client-common-0.12.2.jar:0.12.2]
at
org.apache.hudi.client.HoodieTimelineArchiver.archive(HoodieTimelineArchiver.java:643)
~[hudi-client-common-0.12.2.jar:0.12.2]
at
org.apache.hudi.client.HoodieTimelineArchiver.archiveIfRequired(HoodieTimelineArchiver.java:171)
~[hudi-client-common-0.12.2.jar:0.12.2]
at
org.apache.hudi.client.BaseHoodieWriteClient.archive(BaseHoodieWriteClient.java:922)
~[hudi-client-common-0.12.2.jar:0.12.2]
at
org.apache.hudi.client.BaseHoodieWriteClient.autoArchiveOnCommit(BaseHoodieWriteClient.java:642)
~[hudi-client-common-0.12.2.jar:0.12.2]
at
org.apache.hudi.client.HoodieFlinkWriteClient.postCommit(HoodieFlinkWriteClient.java:369)
~[hudi-flink-client-0.12.2.jar:0.12.2]
at
org.apache.hudi.client.BaseHoodieWriteClient.commitStats(BaseHoodieWriteClient.java:237)
~[hudi-client-common-0.12.2.jar:0.12.2]
at
org.apache.hudi.client.HoodieFlinkWriteClient.commit(HoodieFlinkWriteClient.java:121)
~[hudi-flink-client-0.12.2.jar:0.12.2]
at
org.apache.hudi.sink.StreamWriteOperatorCoordinator.doCommit(StreamWriteOperatorCoordinator.java:531)
~[hudi-flink-0.12.2.jar:0.12.2]
at
org.apache.hudi.sink.StreamWriteOperatorCoordinator.commitInstant(StreamWriteOperatorCoordinator.java:507)
~[hudi-flink-0.12.2.jar:0.12.2]
at
org.apache.hudi.sink.StreamWriteOperatorCoordinator.lambda$notifyCheckpointComplete$2(StreamWriteOperatorCoordinator.java:243)
~[hudi-flink-0.12.2.jar:0.12.2]
at
org.apache.hudi.sink.utils.NonThrownExecutor.lambda$wrapAction$0(NonThrownExecutor.java:130)
~[hudi-flink-0.12.2.jar:0.12.2]
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
[?:1.8.0_202]
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
[?:1.8.0_202]
at java.lang.Thread.run(Thread.java:748) [?:1.8.0_202]
Caused by: java.lang.NullPointerException
at org.apache.avro.io.Encoder.writeString(Encoder.java:130)
~[avro-1.10.0.jar:1.10.0]
at
org.apache.avro.generic.GenericDatumWriter.writeString(GenericDatumWriter.java:346)
~[avro-1.10.0.jar:1.10.0]
at
org.apache.avro.generic.GenericDatumWriter.writeString(GenericDatumWriter.java:338)
~[avro-1.10.0.jar:1.10.0]
at
org.apache.avro.generic.GenericDatumWriter.writeWithoutConversion(GenericDatumWriter.java:151)
~[avro-1.10.0.jar:1.10.0]
at
org.apache.avro.generic.GenericDatumWriter.write(GenericDatumWriter.java:83)
~[avro-1.10.0.jar:1.10.0]
at
org.apache.avro.generic.GenericDatumWriter.writeMap(GenericDatumWriter.java:305)
~[avro-1.10.0.jar:1.10.0]
at
org.apache.avro.generic.GenericDatumWriter.writeWithoutConversion(GenericDatumWriter.java:140)
~[avro-1.10.0.jar:1.10.0]
at
org.apache.avro.generic.GenericDatumWriter.write(GenericDatumWriter.java:83)
~[avro-1.10.0.jar:1.10.0]
at
org.apache.avro.generic.GenericDatumWriter.writeWithoutConversion(GenericDatumWriter.java:145)
~[avro-1.10.0.jar:1.10.0]
at
org.apache.avro.generic.GenericDatumWriter.write(GenericDatumWriter.java:83)
~[avro-1.10.0.jar:1.10.0]
at
org.apache.avro.generic.GenericDatumWriter.writeField(GenericDatumWriter.java:221)
~[avro-1.10.0.jar:1.10.0]
at
org.apache.avro.generic.GenericDatumWriter.writeRecord(GenericDatumWriter.java:210)
~[avro-1.10.0.jar:1.10.0]
at
org.apache.avro.generic.GenericDatumWriter.writeWithoutConversion(GenericDatumWriter.java:131)
~[avro-1.10.0.jar:1.10.0]
at
org.apache.avro.generic.GenericDatumWriter.write(GenericDatumWriter.java:83)
~[avro-1.10.0.jar:1.10.0]
at
org.apache.avro.generic.GenericDatumWriter.writeWithoutConversion(GenericDatumWriter.java:145)
~[avro-1.10.0.jar:1.10.0]
at
org.apache.avro.generic.GenericDatumWriter.write(GenericDatumWriter.java:83)
~[avro-1.10.0.jar:1.10.0]
at
org.apache.avro.generic.GenericDatumWriter.writeField(GenericDatumWriter.java:221)
~[avro-1.10.0.jar:1.10.0]
at
org.apache.avro.generic.GenericDatumWriter.writeRecord(GenericDatumWriter.java:210)
~[avro-1.10.0.jar:1.10.0]
at
org.apache.avro.generic.GenericDatumWriter.writeWithoutConversion(GenericDatumWriter.java:131)
~[avro-1.10.0.jar:1.10.0]
... 21 more
2023-12-06 14:32:16 [ERROR]
org.apache.hudi.sink.StreamWriteOperatorCoordinator : Executor executes
action [commits the instant 20231206143215269] error
org.apache.hudi.exception.HoodieCommitException: Failed to archive commits
at
org.apache.hudi.client.HoodieTimelineArchiver.archive(HoodieTimelineArchiver.java:654)
~[hudi-client-common-0.12.2.jar:0.12.2]
at
org.apache.hudi.client.HoodieTimelineArchiver.archiveIfRequired(HoodieTimelineArchiver.java:171)
~[hudi-client-common-0.12.2.jar:0.12.2]
at
org.apache.hudi.client.BaseHoodieWriteClient.archive(BaseHoodieWriteClient.java:922)
~[hudi-client-common-0.12.2.jar:0.12.2]
at
org.apache.hudi.client.BaseHoodieWriteClient.autoArchiveOnCommit(BaseHoodieWriteClient.java:642)
~[hudi-client-common-0.12.2.jar:0.12.2]
at
org.apache.hudi.client.HoodieFlinkWriteClient.postCommit(HoodieFlinkWriteClient.java:369)
~[hudi-flink-client-0.12.2.jar:0.12.2]
at
org.apache.hudi.client.BaseHoodieWriteClient.commitStats(BaseHoodieWriteClient.java:237)
~[hudi-client-common-0.12.2.jar:0.12.2]
at
org.apache.hudi.client.HoodieFlinkWriteClient.commit(HoodieFlinkWriteClient.java:121)
~[hudi-flink-client-0.12.2.jar:0.12.2]
at
org.apache.hudi.sink.StreamWriteOperatorCoordinator.doCommit(StreamWriteOperatorCoordinator.java:531)
~[hudi-flink-0.12.2.jar:0.12.2]
at
org.apache.hudi.sink.StreamWriteOperatorCoordinator.commitInstant(StreamWriteOperatorCoordinator.java:507)
~[hudi-flink-0.12.2.jar:0.12.2]
at
org.apache.hudi.sink.StreamWriteOperatorCoordinator.lambda$notifyCheckpointComplete$2(StreamWriteOperatorCoordinator.java:243)
~[hudi-flink-0.12.2.jar:0.12.2]
at
org.apache.hudi.sink.utils.NonThrownExecutor.lambda$wrapAction$0(NonThrownExecutor.java:130)
~[hudi-flink-0.12.2.jar:0.12.2]
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
[?:1.8.0_202]
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
[?:1.8.0_202]
at java.lang.Thread.run(Thread.java:748) [?:1.8.0_202]
Caused by: java.lang.NullPointerException: null of string of map of union in
field extraMetadata of org.apache.hudi.avro.model.HoodieCommitMetadata of union
in field hoodieCommitMetadata of
org.apache.hudi.avro.model.HoodieArchivedMetaEntry
at
org.apache.avro.generic.GenericDatumWriter.npe(GenericDatumWriter.java:184)
~[avro-1.10.0.jar:1.10.0]
at
org.apache.avro.generic.GenericDatumWriter.writeWithoutConversion(GenericDatumWriter.java:178)
~[avro-1.10.0.jar:1.10.0]
at
org.apache.avro.generic.GenericDatumWriter.write(GenericDatumWriter.java:83)
~[avro-1.10.0.jar:1.10.0]
at
org.apache.avro.generic.GenericDatumWriter.write(GenericDatumWriter.java:73)
~[avro-1.10.0.jar:1.10.0]
at
org.apache.hudi.common.table.log.block.HoodieAvroDataBlock.serializeRecords(HoodieAvroDataBlock.java:119)
~[hudi-common-0.12.2.jar:0.12.2]
at
org.apache.hudi.common.table.log.block.HoodieDataBlock.getContentBytes(HoodieDataBlock.java:131)
~[hudi-common-0.12.2.jar:0.12.2]
at
org.apache.hudi.common.table.log.HoodieLogFormatWriter.appendBlocks(HoodieLogFormatWriter.java:158)
~[hudi-common-0.12.2.jar:0.12.2]
at
org.apache.hudi.common.table.log.HoodieLogFormatWriter.appendBlock(HoodieLogFormatWriter.java:135)
~[hudi-common-0.12.2.jar:0.12.2]
at
org.apache.hudi.client.HoodieTimelineArchiver.writeToFile(HoodieTimelineArchiver.java:671)
~[hudi-client-common-0.12.2.jar:0.12.2]
at
org.apache.hudi.client.HoodieTimelineArchiver.archive(HoodieTimelineArchiver.java:643)
~[hudi-client-common-0.12.2.jar:0.12.2]
... 13 more
Caused by: java.lang.NullPointerException
at org.apache.avro.io.Encoder.writeString(Encoder.java:130)
~[avro-1.10.0.jar:1.10.0]
at
org.apache.avro.generic.GenericDatumWriter.writeString(GenericDatumWriter.java:346)
~[avro-1.10.0.jar:1.10.0]
at
org.apache.avro.generic.GenericDatumWriter.writeString(GenericDatumWriter.java:338)
~[avro-1.10.0.jar:1.10.0]
at
org.apache.avro.generic.GenericDatumWriter.writeWithoutConversion(GenericDatumWriter.java:151)
~[avro-1.10.0.jar:1.10.0]
at
org.apache.avro.generic.GenericDatumWriter.write(GenericDatumWriter.java:83)
~[avro-1.10.0.jar:1.10.0]
at
org.apache.avro.generic.GenericDatumWriter.writeMap(GenericDatumWriter.java:305)
~[avro-1.10.0.jar:1.10.0]
at
org.apache.avro.generic.GenericDatumWriter.writeWithoutConversion(GenericDatumWriter.java:140)
~[avro-1.10.0.jar:1.10.0]
at
org.apache.avro.generic.GenericDatumWriter.write(GenericDatumWriter.java:83)
~[avro-1.10.0.jar:1.10.0]
at
org.apache.avro.generic.GenericDatumWriter.writeWithoutConversion(GenericDatumWriter.java:145)
~[avro-1.10.0.jar:1.10.0]
at
org.apache.avro.generic.GenericDatumWriter.write(GenericDatumWriter.java:83)
~[avro-1.10.0.jar:1.10.0]
at
org.apache.avro.generic.GenericDatumWriter.writeField(GenericDatumWriter.java:221)
~[avro-1.10.0.jar:1.10.0]
at
org.apache.avro.generic.GenericDatumWriter.writeRecord(GenericDatumWriter.java:210)
~[avro-1.10.0.jar:1.10.0]
at
org.apache.avro.generic.GenericDatumWriter.writeWithoutConversion(GenericDatumWriter.java:131)
~[avro-1.10.0.jar:1.10.0]
at
org.apache.avro.generic.GenericDatumWriter.write(GenericDatumWriter.java:83)
~[avro-1.10.0.jar:1.10.0]
at
org.apache.avro.generic.GenericDatumWriter.writeWithoutConversion(GenericDatumWriter.java:145)
~[avro-1.10.0.jar:1.10.0]
at
org.apache.avro.generic.GenericDatumWriter.write(GenericDatumWriter.java:83)
~[avro-1.10.0.jar:1.10.0]
at
org.apache.avro.generic.GenericDatumWriter.writeField(GenericDatumWriter.java:221)
~[avro-1.10.0.jar:1.10.0]
at
org.apache.avro.generic.GenericDatumWriter.writeRecord(GenericDatumWriter.java:210)
~[avro-1.10.0.jar:1.10.0]
at
org.apache.avro.generic.GenericDatumWriter.writeWithoutConversion(GenericDatumWriter.java:131)
~[avro-1.10.0.jar:1.10.0]
at
org.apache.avro.generic.GenericDatumWriter.write(GenericDatumWriter.java:83)
~[avro-1.10.0.jar:1.10.0]
at
org.apache.avro.generic.GenericDatumWriter.write(GenericDatumWriter.java:73)
~[avro-1.10.0.jar:1.10.0]
at
org.apache.hudi.common.table.log.block.HoodieAvroDataBlock.serializeRecords(HoodieAvroDataBlock.java:119)
~[hudi-common-0.12.2.jar:0.12.2]
at
org.apache.hudi.common.table.log.block.HoodieDataBlock.getContentBytes(HoodieDataBlock.java:131)
~[hudi-common-0.12.2.jar:0.12.2]
at
org.apache.hudi.common.table.log.HoodieLogFormatWriter.appendBlocks(HoodieLogFormatWriter.java:158)
~[hudi-common-0.12.2.jar:0.12.2]
at
org.apache.hudi.common.table.log.HoodieLogFormatWriter.appendBlock(HoodieLogFormatWriter.java:135)
~[hudi-common-0.12.2.jar:0.12.2]
at
org.apache.hudi.client.HoodieTimelineArchiver.writeToFile(HoodieTimelineArchiver.java:671)
~[hudi-client-common-0.12.2.jar:0.12.2]
at
org.apache.hudi.client.HoodieTimelineArchiver.archive(HoodieTimelineArchiver.java:643)
~[hudi-client-common-0.12.2.jar:0.12.2]
... 13 more
2023-12-06 14:32:16 [ INFO] org.apache.flink.runtime.jobmaster.JobMaster
: Trying to recover from a global failure.
{code}
## JIRA info
- Link: https://issues.apache.org/jira/browse/HUDI-7182
- Type: Bug
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
