Hong Shen created HUDI-1005:
-------------------------------
Summary: NPE in HoodieWriteClient.clean
Key: HUDI-1005
URL: https://issues.apache.org/jira/browse/HUDI-1005
Project: Apache Hudi
Issue Type: Bug
Components: Writer Core
Reporter: Hong Shen
Assignee: Hong Shen
HoodieWriteClient.clean will throw NullPointerException, here is the error
message.
{code}
Caused by: java.lang.NullPointerException
at
org.apache.hudi.client.HoodieWriteClient.clean(HoodieWriteClient.java:495)
at
org.apache.hudi.client.HoodieWriteClient.postCommit(HoodieWriteClient.java:344)
at
org.apache.hudi.client.AbstractHoodieWriteClient.commit(AbstractHoodieWriteClient.java:123)
at
org.apache.hudi.client.AbstractHoodieWriteClient.commit(AbstractHoodieWriteClient.java:94)
at
org.apache.hudi.utilities.deltastreamer.DeltaSync.writeToSink(DeltaSync.java:399)
at
org.apache.hudi.utilities.deltastreamer.DeltaSync.syncOnce(DeltaSync.java:232)
at
org.apache.hudi.utilities.deltastreamer.HoodieDeltaStreamer$DeltaSyncService.lambda$startService$0(HoodieDeltaStreamer.java:422)
... 5 more
{code}
When metrics is on HoodieCleanMetadata metadata is null, it will throw NPE.
{code}
public HoodieCleanMetadata clean(String cleanInstantTime) throws
HoodieIOException {
LOG.info("Cleaner started");
final Timer.Context context = metrics.getCleanCtx();
HoodieCleanMetadata metadata = HoodieTable.create(config,
hadoopConf).clean(jsc, cleanInstantTime);
if (context != null) {
long durationMs = metrics.getDurationInMs(context.stop());
metrics.updateCleanMetrics(durationMs, metadata.getTotalFilesDeleted());
LOG.info("Cleaned " + metadata.getTotalFilesDeleted() + " files"
+ " Earliest Retained Instant :" +
metadata.getEarliestCommitToRetain()
+ " cleanerElaspsedMs" + durationMs);
}
return metadata;
}
{code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
