Stefán Baxter created DRILL-3512:
------------------------------------
Summary: json queries fails on unexpected EOL
Key: DRILL-3512
URL: https://issues.apache.org/jira/browse/DRILL-3512
Project: Apache Drill
Issue Type: Improvement
Components: Storage - JSON
Affects Versions: 1.1.0
Reporter: Stefán Baxter
Assignee: Steven Phillips
Priority: Minor
querying directories or files that are open by some writer is a create way to
keep up with data (csv/tsv) being logged out by servers, processes etc.
We did a small test where we appended a copy of our message stream (1k
msg./sec.) to a json file and queried it with Drill. This worked just fine but
every once in a while we would get Unexpected End of Line errors as the writer
was appending to the file as Drill was reading it.
It would be great if an incomplete entry at the end of the file would simply be
ignored.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)