Blazer-007 commented on code in PR #4206: URL: https://github.com/apache/gobblin/pull/4206#discussion_r3673467115
########## gobblin-runtime/src/main/java/org/apache/gobblin/service/monitoring/JobStatusRetriever.java: ########## @@ -60,6 +60,15 @@ public abstract class JobStatusRetriever implements LatestFlowExecutionIdTracker public static final String EVENT_NAME_FIELD = "eventName"; public static final String NA_KEY = "NA"; + // DDM (and other file/blob movement) writers report per-dataset copy metrics on the JobSummary + // GTE via these flat metadata keys; the job-status monitor persists them into the job state, and + // they are surfaced here on the JobStatistics REST surface. -1 = absent/unsupported. + public static final String BYTES_WRITTEN_FIELD = "ddm.bytesCopied"; + public static final String RECORDS_WRITTEN_FIELD = "ddm.rowsCopied"; + public static final String FILES_COMMITTED_FIELD = "ddm.filesCommitted"; + public static final String SNAPSHOTS_COMMITTED_FIELD = "ddm.snapshotsCommitted"; + public static final String PARTITIONS_COMMITTED_FIELD = "ddm.partitionsCommitted"; + Review Comment: can we name this without ddm prefix -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
