wombatu-kun commented on code in PR #20224:
URL: https://github.com/apache/hudi/pull/20224#discussion_r4375469133
##########
hudi-client/hudi-spark-client/src/main/java/org/apache/hudi/index/SparkMetadataTableGlobalRecordLevelIndex.java:
##########
@@ -73,6 +73,7 @@ public
SparkMetadataTableGlobalRecordLevelIndex(HoodieWriteConfig config) {
@Override
public <R> HoodieData<HoodieRecord<R>>
tagLocation(HoodieData<HoodieRecord<R>> records, HoodieEngineContext context,
HoodieTable hoodieTable) throws HoodieIndexException {
+ context.setJobStatus(this.getClass().getSimpleName(), "Record index
lookup: " + hoodieTable.getConfig().getTableName());
Review Comment:
+1
##########
hudi-utilities/src/main/java/org/apache/hudi/utilities/streamer/StreamSync.java:
##########
@@ -710,6 +710,7 @@ Pair<InputBatch, Boolean>
fetchNextBatchFromSource(Option<Checkpoint> resumeChec
InputBatch inputBatchForWriter = null; // row writer
boolean reconcileSchema =
props.getBoolean(DataSourceWriteOptions.RECONCILE_SCHEMA().key());
if (transformer.isPresent()) {
+ hoodieSparkContext.setJobStatus(this.getClass().getSimpleName(),
"Transforming source batch: " + cfg.targetTableName);
Review Comment:
+1
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
