Xuefu Zhang created HIVE-8853:
---------------------------------
Summary: Make vectorization work with Spark [Spark Branch]
Key: HIVE-8853
URL: https://issues.apache.org/jira/browse/HIVE-8853
Project: Hive
Issue Type: Sub-task
Components: Spark
Reporter: Xuefu Zhang
In Hive to make vectorization work, the reader needs to be also vectorized,
which means that the reader can read a chunk of rows (or a list of column
chunks) instead of one row at a time. However, we use Spark RDD for reading,
which again utilized the underlying inputformat to read. Subsequent processing
also needs to hapen in batches. We need to make sure that vectorizatoin is
working as expected.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
