GitHub user sameeragarwal opened a pull request:
https://github.com/apache/spark/pull/11799
[SPARK-13989][SQL] Remove non-vectorized/unsafe-row parquet record reader
## What changes were proposed in this pull request?
This PR cleans up the new parquet record reader with the following changes:
1. Removes the non-vectorized parquet reader code from
`UnsafeRowParquetRecordReader`.
2. Removes the non-vectorized column reader code from `ColumnReader`.
3. Renames `UnsafeRowParquetRecordReader` to
`VectorizedParquetRecordReader` and `ColumnReader` to `VectorizedColumnReader`
## How was this patch tested?
Refactoring only; Existing tests should reveal any problems.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/sameeragarwal/spark vectorized-parquet
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/11799.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #11799
----
commit 9fdb8528287f670a48dffe4d2b91c39b1c0f7f5d
Author: Sameer Agarwal <[email protected]>
Date: 2016-03-17T22:01:18Z
Vectorized Parquet Reader
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
