Re: COPY TO STDOUT Apache Arrow support

2023-05-02 Thread Pavel Stehule
Hi st 3. 5. 2023 v 5:15 odesílatel Adam Lippai napsal: > Hi, > > There is also a new Arrow C library (one .h and one .c file) which makes > it easier to use it from the postgresql codebase. > > https://arrow.apache.org/blog/2023/03/07/nanoarrow-0.1.0-release/ >

Re: COPY TO STDOUT Apache Arrow support

2023-05-02 Thread Adam Lippai
Hi, There is also a new Arrow C library (one .h and one .c file) which makes it easier to use it from the postgresql codebase. https://arrow.apache.org/blog/2023/03/07/nanoarrow-0.1.0-release/ https://github.com/apache/arrow-nanoarrow/tree/main/dist Best regards, Adam Lippai On Thu, Apr 13,

Re: COPY TO STDOUT Apache Arrow support

2023-04-13 Thread Adam Lippai
Hi, There are two bigger developments in this topic: 1. Pandas 2.0 is released and it can use Apache Arrow as a backend 2. Apache Arrow ADBC is released which standardizes the client API. Currently it uses the postgresql wire protocol underneath Best regards, Adam Lippai On Thu, Apr

COPY TO STDOUT Apache Arrow support

2022-04-21 Thread Adam Lippai
Hi, would it be possible to add Apache Arrow streaming format to the copy backend + frontend? The use case is fetching (or storing) tens or hundreds of millions of rows for client side data science purposes (Pandas, Apache Arrow compute kernels, Parquet conversion etc). It looks like the