vahid110 commented on issue #1037: URL: https://github.com/apache/arrow-adbc/issues/1037#issuecomment-4358548836
We hit the same bottleneck. I ended up writing something that wraps COPY FROM STDIN for PostgreSQL writes. Benchmarked at 850x faster than executemany for 1M rows on RDS. Posted it on GH maybe it would be useful for someone https://github.com/arrowjet/arrowjet -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
