[ https://issues.apache.org/jira/browse/PIG-833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12716578#action_12716578 ]
Hong Tang commented on PIG-833: ------------------------------- @Jeff, I might have read a bit too much into the lines. I was referring to your comments on PIG-824. I also took a look at HIVE-279, the predicate push down mentioned there is actually a bit different from what we plan to do. HIVE-279 pushes predicates to map phase, whereby we would like to implement a storage layer where we can filter out bytes while reading data from disk. > Storage access layer > -------------------- > > Key: PIG-833 > URL: https://issues.apache.org/jira/browse/PIG-833 > Project: Pig > Issue Type: New Feature > Reporter: Jay Tang > > A layer is needed to provide a high level data access abstraction and a > tabular view of data in Hadoop, and could free Pig users from implementing > their own data storage/retrieval code. This layer should also include a > columnar storage format in order to provide fast data projection, > CPU/space-efficient data serialization, and a schema language to manage > physical storage metadata. Eventually it could also support predicate > pushdown for further performance improvement. Initially, this layer could be > a contrib project in Pig and become a hadoop subproject later on. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.