Make DynamicSerDe capable of skipping fields that will not be used in the query
-------------------------------------------------------------------------------
Key: HADOOP-4550
URL: https://issues.apache.org/jira/browse/HADOOP-4550
Project: Hadoop Core
Issue Type: New Feature
Components: contrib/hive
Reporter: Pete Wyckoff
Thrift/DynamicSerDe always deseriualize and convert fields to the correct type
for every field in the record. Many times, only a few of the fields will be
used.
e.g., select foo.user from foo where foo.created < 'today'
where foo is something like
struct {
string user
i64 created
string fullname
string description
i32 something
i32 somethingelse
...
}
Parsing fullname, description, something and something else is a waste in this
case.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
