liusitan opened a new issue, #13875: URL: https://github.com/apache/arrow/issues/13875
Hi there, I am trying to hack the arrow IPC format, I am confused about how does arrow differentiate between different type in record batch buffers and parse it. <img width="671" alt="image" src="https://user-images.githubusercontent.com/20542539/184588362-d528770b-79e3-4307-be75-9dfbc01e60a4.png";> for example, now I store a data frame ``` name | age | balance 'jack' | 12. | 100.23 'Jennie' | 24 | 2000.34 ``` I believe 'jack' and 'jennie' is stored in one buffer and 12 and 24 are stored in another buffer 100.23 and 2000.34 is stored in another buffer how does the arrow deserializer know which tools to parse the buffer? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
![https://user-images.githubusercontent.com/20542539/184588362-d528770b-79e3-4307-be75-9dfbc01e60a4.png"](https://user-images.githubusercontent.com/20542539/184588362-d528770b-79e3-4307-be75-9dfbc01e60a4.png"){kind=link}