esadler-hbo opened a new issue, #22813: URL: https://github.com/apache/beam/issues/22813
### What would you like to happen? Hello! I have a version of a `WriteBatchedParquet`, which is like a complement to `ReadBatchedParquet` that I would like to contribute or something similar. **Why?** There is a pretty big performance gain converting batches of scores to pyarrow row-groups and then saving those to directly to parquet without having to split them into python dictionaries per row. This really helped with performance and memory usage for offline batched model inference. I am very happy to work on this, so let me know if there is any interest. .take-issue ### Issue Priority Priority: 3 ### Issue Component Component: io-py-parquet -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
