arenger commented on issue #3414: NIFI-5900 Added SplitLargeJson processor URL: https://github.com/apache/nifi/pull/3414#issuecomment-482096603 @pvillard31 Thanks Pierre! I updated the NOTICE file as you suggested; good catch. @ottobackwards and @pvillard31 (and anyone else): From here, I think there are two main questions: * Should there be an update to the `SplitJson` processor to provide for optionally-optimized large-file processing, or should there be a separate processor for this purpose? * Should JsonSurfer be used for the large-file processing, or should JSON-P (javax.json) be used (in conjunction with the utility classes in this PR)? On the first question, I would still vote for a separate processor for the reasons I mentioned earlier: consistent output format (always emit a JSON doc instead of sometimes) and the ability to split objects instead of arrays only. I could help with any of the four permutations (one processor or two; with javax.json or without). I plan to look into the feasibility of employing JsonSurfer in splitting json, when I can make more time.
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services
