schizophrenicmaniac commented on issue #41485: URL: https://github.com/apache/beam/issues/41485#issuecomment-7019115200
.take-issue Hi, I'd like to work on this. The parquet write leaves the shard count to the runner, so Prism sometimes writes 2 files. I'd drop the exact 'Wrote 1 file:' check in test_pipes_csv_to_parquet_and_back_to_json and check that the listed shards exist instead. The JSON roundtrip already reads every shard. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
