bkietz commented on issue #28994: URL: https://github.com/apache/arrow/issues/28994#issuecomment-1713911497
This was copied from the CSV parser, which was my model when writing the JSON parser. `<csv comments>` I believe originally the intent there was to ensure that a very large chunk of csv text is parsed in batches. I'm not sure the limit has ever been hit in CSV; that would be a very large chunk and we don't seem to have a test for it which goes through the reader. These days the limit seems to be used exclusively for limiting parsing to column headers when we don't need any actual data. @pitrou `</csv comments>` The JSON parser doesn't have a use for this limit, I think. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
