yihua opened a new pull request, #967:
URL: https://github.com/apache/hudi-rs/pull/967
## Description
Two fixes to the upsert benchmark harness. `summarize.py` printed timings,
bytes and file counts for a case that was refused, failed or timed out, taken
from the repetitions it finished before stopping, so a table built from it
could show numbers for a case that produced no result; such a case now shows
`-` in those columns. The Hudi case also read back the five `_hoodie_*` meta
columns, which the oracle comparison drops and the other cases never return;
its reads now project the table's data columns, so every case decodes the same
columns.
## How are the changes test-covered
- [ ] N/A
- [x] Automated tests (unit and/or integration tests)
- [ ] Manual tests
- [ ] Details are described below
`test_summarize.py` checks that a finished case renders its timings and
bytes and that a refused, failed or timed-out one renders none. Smoke runs of
the uuid, training-set (incremental and time-travel reads) and
tpcds-web-returns scenarios pass the sampled and oracle checks on all three
Hudi cases, and the harness tests pass.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
