-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/24289/
-----------------------------------------------------------

(Updated Aug. 12, 2014, 5:07 p.m.)


Review request for hive.


Changes
-------

new patch after addressing Lars and Ashutosh's commetns


Repository: hive-git


Description
-------

This patch provides ability to update certain stats without scanning any data 
or without "hacking the backend db". It helps (esp for CBO work) to set up unit 
tests quickly and verify both cbo and the stats subsystem. It also helps when 
experimenting with the system if you're just trying out hive/hadoop on a small 
cluster. Finally it gives you a quick and clean way to fix things when 
something went wrong wrt stats in your environment.
Usage:
ALTER TABLE table_name PARTITION partition_spec UPDATE STATISTICS FOR COLUMN 
col_name SET col_statistics
For example,
ALTER TABLE src_x_int UPDATE STATISTICS FOR COLUMN key SET 
('numDVs'='101','highValue'='10001.0');
ALTER TABLE src_p PARTITION(partitionId=1) UPDATE STATISTICS FOR COLUMN key SET 
('numDVs'='100','avgColLen'='1.0001');


Diffs
-----

  metastore/src/java/org/apache/hadoop/hive/metastore/StatObjectConverter.java 
c3e2820 
  
metastore/src/model/org/apache/hadoop/hive/metastore/model/MPartitionColumnStatistics.java
 89c31dc 
  
metastore/src/model/org/apache/hadoop/hive/metastore/model/MTableColumnStatistics.java
 44bbab5 
  ql/src/java/org/apache/hadoop/hive/ql/exec/ColumnStatsUpdateTask.java 
PRE-CREATION 
  ql/src/java/org/apache/hadoop/hive/ql/exec/TaskFactory.java 24dfed1 
  
ql/src/java/org/apache/hadoop/hive/ql/metadata/SessionHiveMetaStoreClient.java 
4300145 
  ql/src/java/org/apache/hadoop/hive/ql/parse/DDLSemanticAnalyzer.java 67a3aa7 
  ql/src/java/org/apache/hadoop/hive/ql/parse/HiveParser.g ab1188a 
  ql/src/java/org/apache/hadoop/hive/ql/parse/SemanticAnalyzerFactory.java 
268920a 
  ql/src/java/org/apache/hadoop/hive/ql/plan/ColumnStatsUpdateWork.java 
PRE-CREATION 

Diff: https://reviews.apache.org/r/24289/diff/


Testing
-------


File Attachments (updated)
----------------

HIVE-7506.5.patch
  
https://reviews.apache.org/media/uploaded/files/2014/08/12/db6d16c3-a938-4995-9ae4-401eaae3b676__HIVE-7506.5.patch


Thanks,

pengcheng xiong

Reply via email to