pitrou commented on PR #50945: URL: https://github.com/apache/arrow/pull/50945#issuecomment-5424773130
> @pitrou I gave `iterate_many()` more that a few attempts, but I am running into semantic differences with the previous RapidJSON implementation, especially around stopping after a complete value when it is followed by a partial or malformed value. Hmm, I see. Thanks for trying anyway :-) > At this point, I think manually finding the boundary of the first complete object/array and then validating that slice with simdjson may be simpler and closer to the existing behavior. Do you think that would be a reasonable approach? Well, as a last resort, yes. The problem: 1. We're writing our own JSON parser, which means we must careful test it. 2. We're losing performance unless we implement our own SIMD optimizations. Thoughts @HuaHuaY @cyb70289 ? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
