Rajesh Balamohan created HIVE-23735:

             Summary: Reducer misestimate for export command
                 Key: HIVE-23735
                 URL: https://issues.apache.org/jira/browse/HIVE-23735
             Project: Hive
          Issue Type: Improvement
            Reporter: Rajesh Balamohan


if (dest_tab.getNumBuckets() > 0) {

For "export" command, HS2 creates a dummy table and for this table and gets "1" 
as the number of buckets.

set hive.stats.autogather=false;
export table sample_table to '/tmp/export/sampe_db/t1';

This causes issues in reducer estimates and always lands up with '1' as the 
number of reducer task. 

This message was sent by Atlassian Jira

Reply via email to