[
https://issues.apache.org/jira/browse/DRILL-4653?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15523852#comment-15523852
]
ASF GitHub Bot commented on DRILL-4653:
---------------------------------------
Github user ssriniva123 commented on the issue:
https://github.com/apache/drill/pull/518
There is not much to do except change the JSON parser to support this
functionality.
- Indicate to the parser that a current record terminates when it
encounters a \n (Of course
this then assumes that druid also aligns to record separators using a new
line).
This is a change to make to the jackson parser.
- Right now the current code works for all the standard cases except one
case where the inner
most sub-structure within a JSON is malformed.
Given that this is a great recipe for approximation algorithms , I am
requesting this change to be pulled in.
If need be we can work on change to the jackson parser using a different
request.
> Malformed JSON should not stop the entire query from progressing
> ----------------------------------------------------------------
>
> Key: DRILL-4653
> URL: https://issues.apache.org/jira/browse/DRILL-4653
> Project: Apache Drill
> Issue Type: Improvement
> Components: Storage - JSON
> Affects Versions: 1.6.0
> Reporter: subbu srinivasan
> Fix For: Future
>
>
> Currently Drill query terminates upon first encounter of a invalid JSON line.
> Drill has to continue progressing after ignoring the bad records. Something
> similar to a setting of (ignore.malformed.json) would help.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
