[
https://issues.apache.org/jira/browse/HUDI-2097?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17693177#comment-17693177
]
Xinglong Wang commented on HUDI-2097:
-------------------------------------
Fix exception like below?
```
org.apache.hudi.exception.HoodieException: java.io.IOException: unable to read
commit metadata
at
org.apache.hudi.sink.partitioner.profile.WriteProfiles.getCommitMetadata(WriteProfiles.java:275)
at
org.apache.hudi.source.StreamReadMonitoringFunction.lambda$monitorDirAndForwardSplits$103(StreamReadMonitoringFunction.java:297)
at java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193)
at
java.util.ArrayList$ArrayListSpliterator.forEachRemaining(ArrayList.java:1384)
at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:482)
at
java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:472)
at
java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:708)
at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234)
at java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:499)
at
org.apache.hudi.source.StreamReadMonitoringFunction.monitorDirAndForwardSplits(StreamReadMonitoringFunction.java:297)
at
org.apache.hudi.source.StreamReadMonitoringFunction.run(StreamReadMonitoringFunction.java:216)
at
org.apache.flink.streaming.api.operators.StreamSource.run(StreamSource.java:110)
at
org.apache.flink.streaming.api.operators.StreamSource.run(StreamSource.java:66)
at
org.apache.flink.streaming.runtime.tasks.SourceStreamTask$LegacySourceFunctionThread.run(SourceStreamTask.java:263)
Caused by: java.io.IOException: unable to read commit metadata
at
org.apache.hudi.common.model.HoodieCommitMetadata.fromBytes(HoodieCommitMetadata.java:405)
at
org.apache.hudi.sink.partitioner.profile.WriteProfiles.getCommitMetadata(WriteProfiles.java:271)
... 13 more
Caused by: com.fasterxml.jackson.core.JsonParseException: Unrecognized token
'Objavro': was expecting ('true', 'false' or 'null')
at [Source: UNKNOWN; line: 1, column: 11]
at
com.fasterxml.jackson.core.JsonParser._constructError(JsonParser.java:1798)
at
com.fasterxml.jackson.core.base.ParserMinimalBase._reportError(ParserMinimalBase.java:673)
at
com.fasterxml.jackson.core.json.ReaderBasedJsonParser._reportInvalidToken(ReaderBasedJsonParser.java:2835)
at
com.fasterxml.jackson.core.json.ReaderBasedJsonParser._handleOddValue(ReaderBasedJsonParser.java:1889)
at
com.fasterxml.jackson.core.json.ReaderBasedJsonParser.nextToken(ReaderBasedJsonParser.java:747)
at
com.fasterxml.jackson.databind.ObjectMapper._initForReading(ObjectMapper.java:4129)
at
com.fasterxml.jackson.databind.ObjectMapper._readMapAndClose(ObjectMapper.java:3988)
at
com.fasterxml.jackson.databind.ObjectMapper.readValue(ObjectMapper.java:2992)
at
org.apache.hudi.common.model.HoodieCommitMetadata.fromJsonString(HoodieCommitMetadata.java:187)
at
org.apache.hudi.common.model.HoodieCommitMetadata.fromBytes(HoodieCommitMetadata.java:403)
... 14 more
```
> Fix unable to read commit metadata error
> ----------------------------------------
>
> Key: HUDI-2097
> URL: https://issues.apache.org/jira/browse/HUDI-2097
> Project: Apache Hudi
> Issue Type: Bug
> Components: flink
> Reporter: Zheng yunhong
> Assignee: Zheng yunhong
> Priority: Major
> Labels: pull-request-available
> Fix For: 0.9.0
>
>
> Fix unable to read commit metadata error while reading json style data.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
