yihua commented on code in PR #6350:
URL: https://github.com/apache/hudi/pull/6350#discussion_r964197328
##########
website/docs/metrics.md:
##########
@@ -201,3 +201,32 @@ These `HoodieMetrics` can then be plotted on a standard
tool like grafana. Below
<figure>
<img className="docimage"
src={require("/assets/images/hudi_commit_duration.png").default}
alt="hudi_commit_duration.png" />
</figure>
+
+## List of metrics:
+
+The below metrics are available in all timeline operations that involves a
commit such as deltacommit, compaction, clustering and rollback.
+
+Name | Description
+--- | ---
+commitFreshnessInMs | Milliseconds from the commit end time and the maximum
event time of the incoming records
+commitLatencyInMs | Milliseconds from the commit end time and the minimum
event time of incoming records
+commitTime | Time of commit in epoch milliseconds
+duration | Total time taken for the commit/rollback in milliseconds
+numFilesDeleted | Number of files deleted during a clean/rollback
+numFilesFinalized | Number of files finalized in a write
+totalBytesWritten | Bytes written in a HoodieCommit
+totalCompactedRecordsUpdated | Number of records updated in a compaction
operation
+totalCreateTime | Time taken for file creation during a Hoodie Insert operation
+totalFilesInsert | Number of newly written files in a HoodieCommit
+totalFilesUpdate | Number of files updated in a HoodieCommit
+totalInsertRecordsWritten | Number of records inserted or converted to
updates(for small file handling) in a HoodieCommit
Review Comment:
@yesemsanthoshkumar could you clarify what this means: `converted to
updates(for small file handling)`? I assume the small file handling of parquet
files only considers inserts.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
