u3Izx9ql7vW4 commented on issue #43929: URL: https://github.com/apache/arrow/issues/43929#issuecomment-2327207687
> I currently don't have an example on hand but I have some ideas and I'll try to throw something together. Thanks that would be really helpful. > If you could share what language the follow up process use, recommending specific libraries would be easier but I understand if you can't share. Currently it's all in Python. There are plans to migrate parts of the program to C in the future, but that's quite a ways off and isn't a concern at the moment. > It also sounds like you are working with discrete packages of data (i.e. messages/updates) vs. a continues stream of new batches of the same table? I'm working with batches of records that are sent to me, some on a periodic basis, some not. Each process in the chain derives unique a new tables that is schematically different from the one it receives. > Just to clarify: you don't need to use C to use the C Data API. It should be usable in any language that gives access to an ffi e.g. for python its [CFFI](https://cffi.readthedocs.io/en/stable/) Gotcha, this is cool I didn't know it existed. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@arrow.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
