[jira] [Created] (HIVE-11719) acid insert with dynamic partitioning doesn't create empty buckets

[Eugene Koifman (JIRA)]

Eugene Koifman created HIVE-11719:
-------------------------------------

             Summary: acid insert with dynamic partitioning doesn't create 
empty buckets
                 Key: HIVE-11719
                 URL: https://issues.apache.org/jira/browse/HIVE-11719
             Project: Hive
          Issue Type: Bug
          Components: Transactions
    Affects Versions: 1.0.0
            Reporter: Eugene Koifman
            Assignee: Eugene Koifman




{code:sql}
CREATE TABLE T(a INT, b STRING)
      PARTITIONED BY(ds string)
      CLUSTERED BY(a) INTO 2 BUCKETS
      STORED AS ORC TBLPROPERTIES ('transactional'='true')

insert into T partition (ds) values (1, 'fred', 'today'), (2, 'wilma', 
'yesterday')
{code}

See TestCompactor.dynamicPartitioningUpdate()

This will currently create 1 bucket file in each partition.  This may break 
Bucket based joins on MR since they expect to always have a full complement of 
buckets.
Should not be an issue on Tez.

See FileSinkOperator.createBucketForFileIdx()



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)