Le 11/08/2021 à 21:56, Phillip Cloud a écrit :
I can see how that might be a bit circular. Let me start from the perspective of requirements. We want to be able to reuse the arrow's types and schema, without having to write additional code to move back and forth between compute IR and not-compute-IR. I think that leaves only flatbuffers as an option.
If that's the case then agreed (well, you can always embed as a raw bytestring in other formats, but that wouldn't be pretty).
I just wonder what the complexity of using Flatbuffers is for e.g. Python. Regards Antoine.