shunping opened a new pull request, #40226:
URL: https://github.com/apache/beam/pull/40226

   ### Description
   
   This PR adds a dedicated GCS load test for `ParquetIO` and shared test 
infrastructure for parsing, collecting, and formatting GCS performance metrics 
in integration load tests:
   
   1. **`ByteSizeUtils` in `it:common`:** Utility class to parse human-readable 
byte sizes (e.g., `100MB`, `2.5GiB`, `500KB`) into `long` bytes, and format 
byte counts back into readable strings.
   2. **`GcsIOLoadTestBase`:** Shared base class for GCS file-based I/O load 
tests extending `IOLoadTestBase`. Extracts GCS performance metrics (`gcs_op_*`, 
`gcs_http_read_*`, `gcs_http_write_*`) from pipeline results and formats them.
   3. **`ParquetIOLT`:** Introduces `ParquetIOLT` in 
`it/google-cloud-platform`, testing write, read, and write-then-read 
performance against GCS using `ParquetIO`.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to