Reranko05 commented on PR #49748: URL: https://github.com/apache/arrow/pull/49748#issuecomment-4268384026
Hi @dmitry-chirkov-dremio, if by “before before” you meant the implementation prior to #49660, here are benchmarks across all three stages: Before-before (original, pre-#49660): Small (~100B): ~0 ms Medium (~10KB): 27 ms Large (~1MB): 2832 ms Before (after #49660): Small (~100B): ~0 ms Medium (~10KB): 58 ms Large (~1MB): 4302 ms After (this PR): Small (~100B): ~0 ms Medium (~10KB): 12 ms Large (~1MB): 1126 ms The validation changes introduced some overhead (expected due to additional checks), and this optimization not only removes that regression but also improves performance beyond the original implementation by replacing repeated linear lookups with constant-time table access. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
