[
https://issues.apache.org/jira/browse/HUDI-8635?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17937029#comment-17937029
]
Lin Liu commented on HUDI-8635:
-------------------------------
FileGroupReaderBasedMergeHandle contains stats:
# setTotalLogSizeCompacted
#
setPrevCommit
#
setPrevBaseFile
#
setPartitionPath
#
setFileId
#
setTotalLogReadTimeMs
#
setTotalUpdatedRecordsCompacted
#
setTotalLogFilesCompacted
#
setTotalLogRecords
#
setTotalLogBlocks
#
setTotalCorruptLogBlock
#
setTotalRollbackBlocks
#
getRuntimeStats
General MergeHandle contains stats:
#
setPrevCommit
#
setPrevBaseFile
#
setPartitionPath
#
setFileId
#
setTotalWriteBytes
#
setFileSizeInBytes
#
setNumWrites
#
setNumDeletes
#
setNumUpdateWrites
#
setNumInserts
#
setTotalWriteErrors
> Revisit stats generated in HoodieSparkFileGroupReaderBasedMergeHandle
> ---------------------------------------------------------------------
>
> Key: HUDI-8635
> URL: https://issues.apache.org/jira/browse/HUDI-8635
> Project: Apache Hudi
> Issue Type: Sub-task
> Reporter: Y Ethan Guo
> Assignee: Y Ethan Guo
> Priority: Blocker
> Fix For: 1.0.2
>
> Original Estimate: 2h
> Remaining Estimate: 2h
>
> We need to make sure the write stats generated by the new file group
> reader-based merge handle for compaction (
> HoodieSparkFileGroupReaderBasedMergeHandle) are intact in all cases.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
