[ https://issues.apache.org/jira/browse/HIVE-23442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17105351#comment-17105351 ]
Marta Kuczora commented on HIVE-23442: -------------------------------------- Pushed to master. Thanks a lot [~pvary] for the review! > ACID major compaction doesn't read base directory correctly if it was written > by insert overwrite > ------------------------------------------------------------------------------------------------- > > Key: HIVE-23442 > URL: https://issues.apache.org/jira/browse/HIVE-23442 > Project: Hive > Issue Type: Bug > Affects Versions: 4.0.0 > Reporter: Marta Kuczora > Assignee: Marta Kuczora > Priority: Major > Fix For: 4.0.0 > > Attachments: HIVE-23442.1.patch, HIVE-23442.2.patch > > > Steps to reproduce: > {noformat} > SET hive.acid.direct.insert.enabled=true; > CREATE EXTERNAL TABLE test_comp_txt(a int, b int, c int) STORED AS TEXTFILE; > INSERT INTO test_comp_txt values (1, 1, 1), (2, 2, 2), (3, 3, 3), (4, 4, 4); > CREATE TABLE test_comp(a int, b int, c int) STORED AS ORC > TBLPROPERTIES('transactional'='true'); > INSERT OVERWRITE TABLE test_comp SELECT * FROM test_comp_txt; > UPDATE test_comp SET b=55, c=66 WHERE a=2; > DELETE FROM test_comp WHERE a=4; > UPDATE test_comp SET b=77 WHERE a=1; > SELECT * FROM test_comp; > 3 3 3 > 2 55 66 > 1 77 1 > ALTER TABLE test_comp COMPACT 'MAJOR'; > SELECT * FROM test_comp; > 2 55 66 > 1 77 1 > {noformat} > This issue only occurs if the base directory was created with an insert > overwrite command and the hive.acid.direct.insert.enabled parameter was true. > This issue doesn't affect the query based compaction. -- This message was sent by Atlassian Jira (v8.3.4#803005)