kerwin-zk opened a new pull request, #8486:
URL: https://github.com/apache/paimon/pull/8486
<!-- Please specify the module before the PR name: [core] ... or [flink] ...
-->
### Purpose
Implement the todo left by #7114 in `PaimonV2Write.supportedCustomMetrics`:
`support record metrics for row level ops`.
This PR adds a `number of deleted records` commit metric for V2
copy-on-write DELETE. The V2 row-level operation path only applies to append
tables without deletion vectors or data evolution, so the file-level row counts
are exact and the number of deleted records is exactly:
```
deletedRecords = rowCount(removed files) - rowCount(rewritten files)
```
The value is computed at commit time from the commit messages (no extra IO)
and posted through the existing driver metrics mechanism.
For UPDATE and MERGE, the rewritten files mix copied rows with modified
rows, so record-level counts cannot be derived from file statistics and remain
unreported.
### Tests
Extended `PaimonMetricTest` ("Paimon Metric: delete") to assert
`deletedRecords` for both a partial-file delete and a whole-file delete.
### API and Format
No.
### Documentation
No.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
