Alexey Serbin has posted comments on this change. ( http://gerrit.cloudera.org:8080/23056 )
Change subject: WIP [thirdparty] introduce Flatbuffers ...................................................................... Patch Set 2: > If we use FlatBuffers, how difficult would it be to implement array > pruning (e.g., trimming or filtering elements) without full > deserialization? My understanding is that, unlike Protobuf, > FlatBuffers doesn’t allow easy access or modification of serialized > data without fully decoding it — is that correct? > My understanding is that, unlike Protobuf, > FlatBuffers doesn’t allow easy access or modification of serialized > data without fully decoding it — is that correct? Could you provide a reference from which you came to such a conclusion? As for random access to particular elements, that's exactly the opposite. With Flatbuffers, there isn't a need to de-serialize the whole buffer to access a particular element, but Protobuf require de-serializing the whole buffer to access just a single element. https://capnproto.org/news/2014-06-17-capnproto-flatbuffers-sbe.html https://en.wikipedia.org/wiki/FlatBuffers As for the mutability of the data from the API standpoint, Flatbuffers don't allow for modifying the data in-place. Protobuf object can be modified in-place, but that incurs memory re-allocation if adding elements in the middle of an array anyway. But I don't think this is quite relevant because (a) the server side doesn't need to do any modification on the client data when it uses it as data for write requests (b) I guess were aren't going to expose Flatbuffer objects (nor Protobuf objects) in the client API anyway. -- To view, visit http://gerrit.cloudera.org:8080/23056 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-Project: kudu Gerrit-Branch: master Gerrit-MessageType: comment Gerrit-Change-Id: I89c697b8d80cbbd2af4233d16806a230cedaa81a Gerrit-Change-Number: 23056 Gerrit-PatchSet: 2 Gerrit-Owner: Alexey Serbin <[email protected]> Gerrit-Reviewer: Abhishek Chennaka <[email protected]> Gerrit-Reviewer: Alexey Serbin <[email protected]> Gerrit-Reviewer: Kudu Jenkins (120) Gerrit-Comment-Date: Mon, 23 Jun 2025 19:31:00 +0000 Gerrit-HasComments: No
