[
https://issues.apache.org/jira/browse/HIVE-18309?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16308126#comment-16308126
]
Laszlo Bodor commented on HIVE-18309:
-------------------------------------
This seems to be similar (or the same issue) as HIVE-17722:
{code}
mvn install -q -am -pl itests/qtest -DskipSparkTests -pl itests/qtest
-Dtest=TestMiniLlapLocalCliDriver
-Dqfile=smb_mapjoin_19.q,bucketsortoptimize_insert_2.q -Pitests
{code}
The first line/snippet from smb_mapjoin_19 which makes
bucketsortoptimize_insert_2 fail:
{code}
EXPLAIN
INSERT OVERWRITE TABLE test_table2 PARTITION (ds = '1')
SELECT a.key, a.value FROM test_table1 a WHERE a.ds = '1';
{code}
So bucketsortoptimize_insert_2 fails if smb_mapjoin_19.q contains the following:
{code}
set hive.optimize.bucketmapjoin = true;
set hive.optimize.bucketmapjoin.sortedmerge = true;
set hive.exec.reducers.max = 1;
set hive.merge.mapfiles=false;
set hive.merge.mapredfiles=false;
-- Create two bucketed and sorted tables
CREATE TABLE test_table1 (key INT, value STRING) PARTITIONED BY (ds STRING)
CLUSTERED BY (key) SORTED BY (key) INTO 16 BUCKETS;
CREATE TABLE test_table2 (key INT, value STRING) PARTITIONED BY (ds STRING)
CLUSTERED BY (key) SORTED BY (key) INTO 16 BUCKETS;
FROM src
INSERT OVERWRITE TABLE test_table1 PARTITION (ds = '1') SELECT *;
-- Insert data into the bucketed table by selecting from another bucketed table
-- This should be a map-only operation
EXPLAIN
INSERT OVERWRITE TABLE test_table2 PARTITION (ds = '1')
SELECT a.key, a.value FROM test_table1 a WHERE a.ds = '1';
...
{code}
But it passes without the EXPLAIN INSERT... or with this config:
{code}
set hive.metastore.aggregate.stats.cache.enabled=false;
{code}
[~vgumashta], please check this. Thanks!
> qtests: smb_mapjoin_19.q breaks bucketsortoptimize_insert_2.q
> -------------------------------------------------------------
>
> Key: HIVE-18309
> URL: https://issues.apache.org/jira/browse/HIVE-18309
> Project: Hive
> Issue Type: Bug
> Components: Tests
> Reporter: Zoltan Haindrich
> Assignee: Laszlo Bodor
>
> {code}
> mvn install -q -am -pl itests/qtest -DskipSparkTests -pl itests/qtest
> -Dtest=TestMiniLlapLocalCliDriver
> -Dqfile=smb_mapjoin_19.q,bucketsortoptimize_insert_2.q
> {code}
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
