Steven Phillips created DRILL-1960:
--------------------------------------
Summary: Automatically realloc buffers when vector runs out of
space
Key: DRILL-1960
URL: https://issues.apache.org/jira/browse/DRILL-1960
Project: Apache Drill
Issue Type: Bug
Reporter: Steven Phillips
When reaching the end of a buffer, the current way drill handles this is for
setSafe() to return false, and then whatever operator is doing the write will
send the batch, and the redo the last record. This creates a lot of difficulty,
because it sometimes requires being able to "rewind" the input stream to replay
the last record.
The proposal is to move the handling of buffer sizing and allocation into the
value vectors themselves, making it transparent to the user of the value
vector. The operators will now no longer have to worry about the possibility
that writing into a vector may fail due to lack of space.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)