[
https://issues.apache.org/jira/browse/DRILL-6723?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Arina Ielchiieva resolved DRILL-6723.
-------------------------------------
Resolution: Fixed
Merged with commit id ffd3c352586a5884747edcc5a93b0c625a47e100 in the scope of
DRILL-7388.
> Kafka reader fails on malformed JSON
> ------------------------------------
>
> Key: DRILL-6723
> URL: https://issues.apache.org/jira/browse/DRILL-6723
> Project: Apache Drill
> Issue Type: Bug
> Components: Storage - JSON
> Affects Versions: 1.14.0
> Environment: java version "1.8.0_91"
> Java(TM) SE Runtime Environment (build 1.8.0_91-b14)
> Java HotSpot(TM) 64-Bit Server VM (build 25.91-b14, mixed mode)
> $ bin/drill-embedded
> Aug 30, 2018 5:29:08 PM org.glassfish.jersey.server.ApplicationHandler
> initialize
> INFO: Initiating Jersey application, version Jersey: 2.8 2014-04-29
> 01:25:26...
> apache drill 1.14.0
>
> Reporter: Matt Keranen
> Assignee: Arina Ielchiieva
> Priority: Major
> Fix For: 1.17.0
>
>
> With a Kakfa topic where the first message is a simple string "test", and
> store.json.reader.skip_invalid_records = true, a SELECT * FROM topic still
> fails following error.
> In addition, using an OFFSET does not appear to allow the bad messages to be
> bypassed. Same error occurs on the first message.
> {noformat}
> 0: jdbc:drill:zk=local> select * from kafka.`logs` limit 5;
> Error: DATA_READ ERROR: Failure while reading messages from kafka.
> Recordreader was at record: 1
> Not a JSON Object: "TEST"
> Fragment 0:0
> [Error Id: 965d7a69-3d77-4a11-9613-3892a95c4a63 on x.x.x.x:31010]
> (state=,code=0)
> {noformat}
> Description:
> New option {{store.kafka.reader.skip_invalid_records}} will be introduced to
> cover this case. Default is false.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
