JOBIN-SABU opened a new pull request, #45443:
URL: https://github.com/apache/arrow/pull/45443
Fixes issue #45394: Handle single-line JSON without line ending
- Previously, if a file contained only one line of JSON and lacked a newline
character at the end,
`pyarrow.dataset.dataset` would correctly infer the schema but fail to
load the values from that row.
- This fix ensures that such cases are handled properly.
- Additionally, I have fixed some other minor issues in the code.
- Tests are still not passing, but they were already failing before these
changes.
- I believe the issue might be on the upstream side, but please review.
Looking forward to feedback!
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
