schizophrenicmaniac opened a new pull request, #41488: URL: https://github.com/apache/beam/pull/41488
The parquet write in `test_pipes_csv_to_parquet_and_back_to_json` leaves the shard count to the runner, and Prism sometimes writes two files, so the exact `Wrote 1 file:` check fails now and then. The test now accepts any number of files in that message. It checks that each listed path exists and starts with the output prefix. The JSON step afterwards already reads every shard with `users.parquet*` and still checks the exact rows, so the roundtrip coverage is the same. Fixes #41485 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
