Awesome06 commented on PR #55425: URL: https://github.com/apache/arrow/pull/55425#issuecomment-6845463036
@dmitry-chirkov-dremio Yes, I think it is well worth it. Baseline was simple only because it used the generic executor and ignored the 4-byte prefix. In real workloads (selective filters), 90%+ of rows are mismatches or short inline strings, where Option A is **4.7x faster on scalars**, **2x on mismatches**, and **1.5x on inline strings**. The ~14% drop only hits when 100% of rows are identical >12 B strings, and even there it remains **3x faster than the OG baseline**. Trading that corner-case for 4.7x on selective filters fulfills why we use StringView, without needing runtime heuristics like Option B. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
