kou commented on PR #28: URL: https://github.com/apache/arrow-flight-sql-postgresql/pull/28#issuecomment-1461257825
@lidavidm I created a simple random integer only benchmark and measured performance with Apache Arrow Flight SQL, PostgreSQL's C API and `psql`. Do you think that this is fast enough? I want to use your thought to determine whether the current approach is reasonable or not.  Shorter is faster. https://github.com/kou/arrow-flight-sql-postgresql/blob/benchmark-integer/benchmark/integer/README.md#result has numbers. The number of records in a record batch: 1M (`1024 * 1024`) Summary: * PostgreSQL C API and `psql` has similar numbers (because `psql` uses PostgreSQL C API internally) * With 100K (`100 * 1000`) records, Apache Arrow Flight SQL is a bit slower than others * With 1M (`1 * 1000 * 1000`) records, Apache Arrow Flight SQL is a bit faster than others * With 10M (`1 * 1000 * 1000`) records, Apache Arrow Flight SQL is 2x faster than others -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
