Github user viirya commented on the issue:
https://github.com/apache/spark/pull/20648
Yes, thanks @HyukjinKwon for checking the behavior. If we look at the codes
of JSON parser, we will find many places indicating the expectation of
availability of partial results.
For example in `BadRecordException`, there is `partialResult` which is
supposed to hold partial result of parsing a bad record. But we never really
use it to return partial result but just use `None` for it.
Note: If we don't want to return partial result at all, we should refactor
this part of code to make it clear. If we decide not to change current
behavior, I can submit another PR to do refactoring.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
