-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/32499/
-----------------------------------------------------------

(Updated March 26, 2015, 8:51 p.m.)


Review request for hive.


Changes
-------

Fixed changes based on feedback comments.
Also, enhance the recursive method getSchemaType, and named 
getProjectedGroupsFields().


Bugs: HIVE-10086
    https://issues.apache.org/jira/browse/HIVE-10086


Repository: hive-git


Description
-------

Attached is the patch that handles schema that do not match between Parquet and 
Hive.

The access to Parquet data is with name matching in this case. The table column 
may have different schema order, but if the name matches the parquet column 
name, then the value is retrieved.

Also, if the Hive schema has columns and struct elements that do not match with 
the Parquet schema, then it will return NULL values instead.


Diffs (updated)
-----

  
ql/src/java/org/apache/hadoop/hive/ql/io/parquet/convert/DataWritableRecordConverter.java
 a43661eb54ba29692c07c264584b5aecf648ef99 
  
ql/src/java/org/apache/hadoop/hive/ql/io/parquet/read/DataWritableReadSupport.java
 57ae7a9740d55b407cadfc8bc030593b29f90700 
  
ql/src/java/org/apache/hadoop/hive/ql/io/parquet/read/ParquetRecordReaderWrapper.java
 a26199612cf338e336f210f29acb0398c536e1f9 
  ql/src/test/queries/clientpositive/parquet_schema_evolution.q PRE-CREATION 
  ql/src/test/queries/clientpositive/parquet_table_with_subschema.q 
PRE-CREATION 
  ql/src/test/results/clientpositive/parquet_schema_evolution.q.out 
PRE-CREATION 
  ql/src/test/results/clientpositive/parquet_table_with_subschema.q.out 
PRE-CREATION 

Diff: https://reviews.apache.org/r/32499/diff/


Testing
-------


Thanks,

Sergio Pena

Reply via email to