Nong Li created SPARK-13255:
-------------------------------
Summary: Integrate vectorized parquet scan with whole stage
codegen.
Key: SPARK-13255
URL: https://issues.apache.org/jira/browse/SPARK-13255
Project: Spark
Issue Type: Task
Components: SQL
Reporter: Nong Li
The generated whole stage codegen is intended to be run over batches of rows.
This task is to integrate ColumnarBatches with whole stage codegen.
The resulting generated code should look something like:
{code}
Iterator<ColumnarBatch> input;
void process() {
while (input.hasNext()) {
ColumnarBatch batch = input.next();
for (Row: batch) {
// Current function
}
}
}
{code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
