Re: Python Flight example with query command

2021-05-17 Thread Tanveer Ahmad - EWI
least an interface for database systems to make themselves available over Flight and for clients to generically query them. However that proposal has been stalled for a while. Best, David On 2021/05/15 12:15:26, Tanveer Ahmad - EWI wrote: > Hi all, > > > For Python Fligh

Python Flight example with query command

2021-05-15 Thread Tanveer Ahmad - EWI
Hi all, For Python Flight example, I can start server (python server.py -> Serving on grpc+tcp://localhost:5005) and client can put (python client.py put localhost:5005 mycsv.csv) and also get (python client.py get

Arrow Flight in C

2021-04-08 Thread Tanveer Ahmad - EWI
Hi, I need some help in sending Arrow RecordBatches over Arrow Flight inside a C application. As there is no interface for Arrow Flight is available for Arrow CGlib. Does someone have some custom C interface/suggestions to use C++ functions for Arrow Flight inside a C application. Thanks.

Re: Flight API for c_glib

2020-03-29 Thread Tanveer Ahmad - EWI
Thanks Kou for reply. Regards, Tanveer Ahmad From: Sutou Kouhei Sent: Thursday, March 26, 2020 9:29:28 PM To: dev@arrow.apache.org Subject: Re: Flight API for c_glib Hi, In "Flight API for c_glib" on Thu, 26 Mar 2020 16:01:25 +, Tanveer A

Flight API for c_glib

2020-03-26 Thread Tanveer Ahmad - EWI
Hi, I am wondering whether some work is being done on Flight API for c_glib? Regards, Tanveer Ahmad

Re: In-memory sorting of plasma objects

2019-08-23 Thread Tanveer Ahmad - EWI
we don't have this implemented (yet) natively in Apache Arrow - Wes On Thu, Aug 22, 2019 at 8:34 AM Tanveer Ahmad - EWI wrote: > > Hi, > > > I need some help regarding data exchange between Arrow based plasma shared > memory objects on cluster nodes. > > > I have two P

In-memory sorting of plasma objects

2019-08-22 Thread Tanveer Ahmad - EWI
Hi, I need some help regarding data exchange between Arrow based plasma shared memory objects on cluster nodes. I have two Plasma shared memory objects each contains a RecordBatch on different nodes of a cluster. I want to use pandas dataframes or something like that (dask) on a single node

Re: Java OutOfMemoryException!

2019-03-24 Thread Tanveer Ahmad - EWI
. rootAllocator.newChildAllocator(...)). Razvan On Sun, Mar 24, 2019 at 12:33 PM Tanveer Ahmad - EWI wrote: > Hi, > > I am de-serializing multiple plasma objects in java at the same time, > everything is working fine but when the data size increases the following > error is being occurred for so

Java OutOfMemoryException!

2019-03-24 Thread Tanveer Ahmad - EWI
Hi, I am de-serializing multiple plasma objects in java at the same time, everything is working fine but when the data size increases the following error is being occurred for some threads. Any suggestion where I can increase/change the memory allocation for these processes (I have more memory

Parquet format in Java

2018-10-19 Thread Tanveer Ahmad - EWI
Hi, In Java, I'm getting plasma object from C++ (in parquet format) as byte[] buffer. How can I convert it to back to Arrow Schema/columns? Thanks. -- Regards, Tanveer Ahmad

RE: parquet-column_scanner-test failure

2018-10-11 Thread Tanveer Ahmad - EWI
Uwe On Thu, Oct 11, 2018, at 12:33 PM, Tanveer Ahmad - EWI wrote: > Hi, > > I enabled following flags and got error in the attachment (parquet- > column_scanner-test failure) in making arrow build 11. > > cmake .. -DCMAKE_BUILD_TYPE=Release -DARROW_PARQUET=ON -DARROW_PLASMA=ON > -

parquet-column_scanner-test failure

2018-10-11 Thread Tanveer Ahmad - EWI
Hi, I enabled following flags and got error in the attachment (parquet-column_scanner-test failure) in making arrow build 11. cmake .. -DCMAKE_BUILD_TYPE=Release -DARROW_PARQUET=ON -DARROW_PLASMA=ON -DARROW_PLASMA_JAVA_CLIENT=ON Any help in this regard? Thanks. Regards, -- Tanveer Ahmad PhD