GitHub user infogulch added a comment to the discussion: Arrow as zero-serialization target
> we don't need to deserialize it in order to access those metadata fields Oh I see, so you're referring to avoiding copying when iggy accesses internal metadata. That makes sense to me. > iggy uses batching for better tput, which means that realistically you end up > having Vec<Message> In that case maybe you should reconsider Arrow; having all the metadata arranged in dense arrays separate from message content could be beneficial for cache locality and simd vectorization. GitHub link: https://github.com/apache/iggy/discussions/1602#discussioncomment-12479189 ---- This is an automatically sent email for [email protected]. To unsubscribe, please send an email to: [email protected]
