Paul Rogers created DRILL-7730:
----------------------------------
Summary: Reduce overhead of web queries displayed in HTML
Key: DRILL-7730
URL: https://issues.apache.org/jira/browse/DRILL-7730
Project: Apache Drill
Issue Type: Improvement
Affects Versions: 1.17.0
Reporter: Paul Rogers
Assignee: Paul Rogers
Fix For: 1.18.0
Drill provides a web console to run queries. Query results appear as HTML
pages. Drill buffers the query results in-memory to build the page. The current
approach has two problems (in addition to the overhead of buffering):
* To move each batch from Screen to the REST client, we serialize all vectors
into a single large buffer, then recreate the individual vectors.
* The code appends column names and metadata for each batch. For a multi-batch
query, we end up with lists that contain many copies of the same data.
This change modifies the internal plumbing to transfer a record batch from
Screen to REST without copying.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
