Steven created ARROW-8719: ----------------------------- Summary: Stream data easily- function to convert record batch to streamable format Key: ARROW-8719 URL: https://issues.apache.org/jira/browse/ARROW-8719 Project: Apache Arrow Issue Type: Wish Components: C Environment: Linux Reporter: Steven Attachments: code.zip
I am currently working on a project that need to send the data in different processes. Instead of storing it in a file, I am using the IPC stream method, storing it into a buffer. When I try to send the data(bytes) through a socket, I loose the data in the client side. ( Which gives me the idea that when i leave the function(create buffer in the server side folder), I loose acces to that data. Can there be an example that explains this. Also, can you implement a function that convert the record batch into the format that can be sent through the socket directly. The code are in the attachment, one for the server side code and the other for the client side code. Thank you -- This message was sent by Atlassian Jira (v8.3.4#803005)