Matt Keranen created DRILL-6723:
-----------------------------------
Summary: Kafka reader fails on malformed JSON
Key: DRILL-6723
URL: https://issues.apache.org/jira/browse/DRILL-6723
Project: Apache Drill
Issue Type: Bug
Components: Storage - JSON
Affects Versions: 1.14.0
Environment: java version "1.8.0_91"
Java(TM) SE Runtime Environment (build 1.8.0_91-b14)
Java HotSpot(TM) 64-Bit Server VM (build 25.91-b14, mixed mode)
$ bin/drill-embedded
Aug 30, 2018 5:29:08 PM org.glassfish.jersey.server.ApplicationHandler
initialize
INFO: Initiating Jersey application, version Jersey: 2.8 2014-04-29 01:25:26...
apache drill 1.14.0
Reporter: Matt Keranen
With a Kakfa topic where the first message is a simple string "test", and
store.json.reader.skip_invalid_records = true, a SELECT * FROM topic still
fails following error.
In addition, using an OFFSET does not appear to allow the bad messages to be
bypassed. Same error occurs on the first message.
{noformat}
0: jdbc:drill:zk=local> select * from kafka.`logs` limit 5;
Error: DATA_READ ERROR: Failure while reading messages from kafka. Recordreader
was at record: 1
Not a JSON Object: "TEST"
Fragment 0:0
[Error Id: 965d7a69-3d77-4a11-9613-3892a95c4a63 on x.x.x.x:31010]
(state=,code=0)
{noformat}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
