nsivabalan edited a comment on issue #3603: URL: https://github.com/apache/hudi/issues/3603#issuecomment-931267143
I do see from [code](https://github.com/apache/hudi/blob/47ed91799943271f219419cf209793a98b3f09b5/hudi-utilities/src/main/java/org/apache/hudi/utilities/deltastreamer/DeltaSync.java#L506) that we do add entry to extra metadata as below ``` HashMap<String, String> checkpointCommitMetadata = new HashMap<>(); checkpointCommitMetadata.put(CHECKPOINT_KEY, checkpointStr); if (cfg.checkpoint != null) { checkpointCommitMetadata.put(CHECKPOINT_RESET_KEY, cfg.checkpoint); } ``` So, entire map is not null for sure. Can you enable logs and see whats the checkpointStr after reading from source. may be its null w/ SqlSource in this case. Also, have you set --commit-on-errors config in deltastreamer by any chance? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
