Shubham Sharma created HAWQ-1527: ------------------------------------ Summary: Implement partition pushdown for integral data types when accessing hive through pxf Key: HAWQ-1527 URL: https://issues.apache.org/jira/browse/HAWQ-1527 Project: Apache HAWQ Issue Type: Improvement Components: PXF Reporter: Shubham Sharma Assignee: Ed Espino
Hive, when accessed through hcatalog, currently supports partition filtering using columns whose datatype is either string or one of the integral data types (which are TINYINT, SMALLINT, INT, BIGINT). However pxf currently ignores non string partition columns([code reference | https://github.com/apache/incubator-hawq/blob/master/pxf/pxf-hive/src/main/java/org/apache/hawq/pxf/plugins/hive/HiveDataFragmenter.java#L427-#L431]) Hive supports only two operations while filtering partition using integral columns. these operations are "=" and "!=" . [Code reference|https://github.com/apache/hive/blob/branch-1.2/metastore/src/java/org/apache/hadoop/hive/metastore/parser/ExpressionTree.java#L433-#L457] for hive ExpressionTree. Hive introduced a parameter hive.metastore.integral.jdo.pushdown which must be set to true in hive-site.xml to enable filtering on integral datatypes. Logging this JIRA to implement this feature and enable partition filtering using Integral data types from pxf. -- This message was sent by Atlassian JIRA (v6.4.14#64029)