[jira] [Created] (HIVE-20282) HiveServer2 incorrect queue name when using Tez instead of MR
Steve Yeom created HIVE-20282: - Summary: HiveServer2 incorrect queue name when using Tez instead of MR Key: HIVE-20282 URL: https://issues.apache.org/jira/browse/HIVE-20282 Project: Hive Issue Type: Bug Components: Hive Affects Versions: 4.0.0 Reporter: Steve Yeom Assignee: Steve Yeom Fix For: 4.0.0 -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (HIVE-20186) Incorrect results when hive.tez.cartesian-product.enabled=false and vectorization enabled
Steve Yeom created HIVE-20186:
-
Summary: Incorrect results when
hive.tez.cartesian-product.enabled=false and vectorization enabled
Key: HIVE-20186
URL: https://issues.apache.org/jira/browse/HIVE-20186
Project: Hive
Issue Type: Bug
Components: Vectorization
Affects Versions: 4.0.0
Reporter: Steve Yeom
Fix For: 4.0.0
select
CAST(180615145920496 AS BIGINT) AS IDP_AUDIT_ID
, CAST('2017-12-28' AS DATE) AS IDP_DATA_DATE
, fi.BMO_CODED
, inv.IDP_WAREHOUSE_ID
, inv.IDP_AUDIT_ID
, inv.baseline_is_current
, case when inv.baseline_is_current = '1' then 'Y' else 'N' end as
inv_baseline_is_current
, INV.PROJECT_KEY AS INV_KEY
from clarity__L3_SNAP_NUMBER snap, l3_monthly_dw_dimproject inv
LEFT OUTER JOIN L3_MONTHLY_FI_PROG_PROJ_NEWHIERARCHY hier
on INV.PROJECT_KEY = HIER.PROJECT_KEY AND HIER.IDP_DATA_DATE = '2017-12-28'
LEFT OUTER JOIN clarity__l3_monthly_dw_dimproject_fi fi
ON HIER.FUNDING_ITEM_KEY = FI.PROJECT_KEY AND FI.IDP_DATA_DATE = '2017-12-28'
INNER JOIN l3_dw_snapshot_control sc
ON 1=1 AND SC.IDP_DATA_DATE = '2017-12-28' AND SC.SNAPSHOT_ALIAS LIKE 'Month%'
WHERE INV.L3_SNAPSHOT_NUMBER= snap.L3_snapshot_number AND INV.IDP_DATA_DATE =
'2017-12-28'
order by idp_warehouse_id;
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Created] (HIVE-20115) acid_no_buckets.q fails
Steve Yeom created HIVE-20115: - Summary: acid_no_buckets.q fails Key: HIVE-20115 URL: https://issues.apache.org/jira/browse/HIVE-20115 Project: Hive Issue Type: Sub-task Components: Transactions Affects Versions: 4.0.0 Reporter: Steve Yeom Fix For: 4.0.0 -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (HIVE-20110) Bypass HMS CachedStore for transactional stats
Steve Yeom created HIVE-20110: - Summary: Bypass HMS CachedStore for transactional stats Key: HIVE-20110 URL: https://issues.apache.org/jira/browse/HIVE-20110 Project: Hive Issue Type: Sub-task Components: Transactions Affects Versions: 4.0.0 Reporter: Steve Yeom Fix For: 4.0.0 -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (HIVE-20107) stats_part2.q fails
Steve Yeom created HIVE-20107: - Summary: stats_part2.q fails Key: HIVE-20107 URL: https://issues.apache.org/jira/browse/HIVE-20107 Project: Hive Issue Type: Sub-task Components: Transactions Affects Versions: 4.0.0 Reporter: Steve Yeom Fix For: 4.0.0 -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (HIVE-19975) Checking writeIdList per table may not check the commit level of a partition on a partitioned table.
Steve Yeom created HIVE-19975: - Summary: Checking writeIdList per table may not check the commit level of a partition on a partitioned table. Key: HIVE-19975 URL: https://issues.apache.org/jira/browse/HIVE-19975 Project: Hive Issue Type: Sub-task Components: Transactions Affects Versions: 4.0.0 Reporter: Steve Yeom Fix For: 4.0.0 writeIdList is per table entity but stats for a partitioned table are per partition. I.e., each record in PARTITIONS has an independent stats. So if we check the validity of a partition's stats, we need to check in the context of a partiton. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (HIVE-19963) metadata_only_queries.q fails
Steve Yeom created HIVE-19963: - Summary: metadata_only_queries.q fails Key: HIVE-19963 URL: https://issues.apache.org/jira/browse/HIVE-19963 Project: Hive Issue Type: Sub-task Components: Transactions Affects Versions: 4.0.0 Reporter: Steve Yeom Fix For: 4.0.0 -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (HIVE-19954) TestTxnCommands2#testNonAcidToAcidConversion1 fails
Steve Yeom created HIVE-19954: - Summary: TestTxnCommands2#testNonAcidToAcidConversion1 fails Key: HIVE-19954 URL: https://issues.apache.org/jira/browse/HIVE-19954 Project: Hive Issue Type: Sub-task Components: Transactions Affects Versions: 4.0.0 Reporter: Steve Yeom Fix For: 4.0.0 -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (HIVE-19953) query9.q fails
Steve Yeom created HIVE-19953: - Summary: query9.q fails Key: HIVE-19953 URL: https://issues.apache.org/jira/browse/HIVE-19953 Project: Hive Issue Type: Sub-task Components: Transactions Affects Versions: 4.0.0 Reporter: Steve Yeom Fix For: 4.0.0 -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (HIVE-19939) Verify any other aggregation functions other than COUNT
Steve Yeom created HIVE-19939: - Summary: Verify any other aggregation functions other than COUNT Key: HIVE-19939 URL: https://issues.apache.org/jira/browse/HIVE-19939 Project: Hive Issue Type: Sub-task Components: Transactions Affects Versions: 4.0.0 Reporter: Steve Yeom Fix For: 4.0.0 1. More on MAX I have added MAX query into stats_part.q and stats_nonpart.q but showed a slightly different explain.out which might be a bug. 2. Other functions than MAX and COUNT. Also I think we need to check other possible aggregation functions than MAX and COUNT. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (HIVE-19934) Verify ACID table UPDATE/DELETE commands on transactional stats.
Steve Yeom created HIVE-19934: - Summary: Verify ACID table UPDATE/DELETE commands on transactional stats. Key: HIVE-19934 URL: https://issues.apache.org/jira/browse/HIVE-19934 Project: Hive Issue Type: Sub-task Components: Transactions Affects Versions: 4.0.0 Reporter: Steve Yeom Fix For: 4.0.0 ACID table UPDATE/DELETE 1. should accurately compute table stats (if started from accurate stats status and with hive.stats.autogather or hive.starts.column.autogather being true) and keep "true" for "BASIC_STATS" of COLUMN_STATS_ACCURATE. 2. should turn off COLUMN_STATS (or turn to "false"). -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (HIVE-19932) INSERT INTO SELECT case test may be needed.
Steve Yeom created HIVE-19932: - Summary: INSERT INTO SELECT case test may be needed. Key: HIVE-19932 URL: https://issues.apache.org/jira/browse/HIVE-19932 Project: Hive Issue Type: Sub-task Components: Transactions Affects Versions: 4.0.0 Reporter: Steve Yeom Fix For: 4.0.0 INSERT INTO SELECT case test may be needed to make sure this command is executed correctly in that next SELECT COUNT/MAX/MIN works only with stats. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (HIVE-19931) stats_nonpart.q test run shows possibly wrong results.
Steve Yeom created HIVE-19931: - Summary: stats_nonpart.q test run shows possibly wrong results. Key: HIVE-19931 URL: https://issues.apache.org/jira/browse/HIVE-19931 Project: Hive Issue Type: Sub-task Components: Transactions Affects Versions: 4.0.0 Reporter: Steve Yeom Fix For: 4.0.0 -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (HIVE-19930) Resolve explain.out differences introduced by this fearture
Steve Yeom created HIVE-19930: - Summary: Resolve explain.out differences introduced by this fearture Key: HIVE-19930 URL: https://issues.apache.org/jira/browse/HIVE-19930 Project: Hive Issue Type: Sub-task Components: Transactions Affects Versions: 4.0.0 Reporter: Steve Yeom Fix For: 4.0.0 -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (HIVE-19903) Disable temporary insert-only transactional table
Steve Yeom created HIVE-19903: - Summary: Disable temporary insert-only transactional table Key: HIVE-19903 URL: https://issues.apache.org/jira/browse/HIVE-19903 Project: Hive Issue Type: Bug Components: Transactions Affects Versions: 4.0.0 Reporter: Steve Yeom Fix For: 4.0.0 -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (HIVE-19887) One item in pom.xml still has 3.1.0 causing Metastore releated tables related test failures.
Steve Yeom created HIVE-19887: - Summary: One item in pom.xml still has 3.1.0 causing Metastore releated tables related test failures. Key: HIVE-19887 URL: https://issues.apache.org/jira/browse/HIVE-19887 Project: Hive Issue Type: Bug Components: Hive Affects Versions: 4.0.0 Reporter: Steve Yeom Fix For: 4.0.0 Test failures due to this issue include any table access operations to tables that are modified by hive-schema-4.0.0.xxx.sql -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (HIVE-19867) Test and verify Concurrent INSERTS
Steve Yeom created HIVE-19867: - Summary: Test and verify Concurrent INSERTS Key: HIVE-19867 URL: https://issues.apache.org/jira/browse/HIVE-19867 Project: Hive Issue Type: Sub-task Components: Transactions Affects Versions: 4.0.0 Reporter: Steve Yeom Fix For: 4.0.0 -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (HIVE-19865) Full ACID table stats has wrong rawDataSize
Steve Yeom created HIVE-19865: - Summary: Full ACID table stats has wrong rawDataSize Key: HIVE-19865 URL: https://issues.apache.org/jira/browse/HIVE-19865 Project: Hive Issue Type: Sub-task Components: Transactions Affects Versions: 4.0.0 Reporter: Steve Yeom Fix For: 4.0.0 -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (HIVE-19577) CREATE TEMPORARY TABLE LIKE and INSERT generate output format mismatch errors
Steve Yeom created HIVE-19577: - Summary: CREATE TEMPORARY TABLE LIKE and INSERT generate output format mismatch errors Key: HIVE-19577 URL: https://issues.apache.org/jira/browse/HIVE-19577 Project: Hive Issue Type: Bug Components: Hive Affects Versions: 3.0.0 Reporter: Steve Yeom Fix For: 3.1.0 -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (HIVE-19533) Modify Hive to support transactional-stats-using aggregation queries with all other than COUNT
Steve Yeom created HIVE-19533: - Summary: Modify Hive to support transactional-stats-using aggregation queries with all other than COUNT Key: HIVE-19533 URL: https://issues.apache.org/jira/browse/HIVE-19533 Project: Hive Issue Type: Sub-task Components: Hive Affects Versions: 3.0.0 Reporter: Steve Yeom Assignee: Steve Yeom Fix For: 3.1.0 -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (HIVE-19532) Modify Hive Driver/Executor to support transactional-stats-using COUNT aggregation queries
Steve Yeom created HIVE-19532: - Summary: Modify Hive Driver/Executor to support transactional-stats-using COUNT aggregation queries Key: HIVE-19532 URL: https://issues.apache.org/jira/browse/HIVE-19532 Project: Hive Issue Type: Sub-task Components: Hive Affects Versions: 3.0.0 Reporter: Steve Yeom Fix For: 3.1.0 -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (HIVE-19481) sample10.q returns possibly wrong results for insert-only transactional table
Steve Yeom created HIVE-19481: - Summary: sample10.q returns possibly wrong results for insert-only transactional table Key: HIVE-19481 URL: https://issues.apache.org/jira/browse/HIVE-19481 Project: Hive Issue Type: Bug Components: Hive Affects Versions: 3.0.0 Reporter: Steve Yeom Fix For: 3.1.0 -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (HIVE-19470) Modify metastore to have application logic to retrieve/update transactional table stats
Steve Yeom created HIVE-19470: - Summary: Modify metastore to have application logic to retrieve/update transactional table stats Key: HIVE-19470 URL: https://issues.apache.org/jira/browse/HIVE-19470 Project: Hive Issue Type: Sub-task Components: Hive Reporter: Steve Yeom Fix For: 3.0.0 -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (HIVE-19417) Modify metastore to have persistent tables/objects
Steve Yeom created HIVE-19417: - Summary: Modify metastore to have persistent tables/objects Key: HIVE-19417 URL: https://issues.apache.org/jira/browse/HIVE-19417 Project: Hive Issue Type: Sub-task Components: Hive Affects Versions: 3.0.0 Reporter: Steve Yeom Assignee: Steve Yeom Fix For: 3.0.0 -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (HIVE-19416) Create single version transactional table metastore statistics for aggregation queries
Steve Yeom created HIVE-19416: - Summary: Create single version transactional table metastore statistics for aggregation queries Key: HIVE-19416 URL: https://issues.apache.org/jira/browse/HIVE-19416 Project: Hive Issue Type: Bug Components: Hive Reporter: Steve Yeom Assignee: Steve Yeom Fix For: 3.0.0 The system should use only statistics for aggregation queries like count on transactional tables. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (HIVE-19414) Cover partitioned table stats update/retrieve cases
Steve Yeom created HIVE-19414: - Summary: Cover partitioned table stats update/retrieve cases Key: HIVE-19414 URL: https://issues.apache.org/jira/browse/HIVE-19414 Project: Hive Issue Type: Sub-task Affects Versions: 3.0.0 Reporter: Steve Yeom Fix For: 3.0.0 -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (HIVE-19413) Add/use writeId and validWriteIdList during update and for reteive.
Steve Yeom created HIVE-19413: - Summary: Add/use writeId and validWriteIdList during update and for reteive. Key: HIVE-19413 URL: https://issues.apache.org/jira/browse/HIVE-19413 Project: Hive Issue Type: Sub-task Affects Versions: 3.0.0 Reporter: Steve Yeom Assignee: Steve Yeom Fix For: 3.0.0 -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (HIVE-19412) Possible invalid Full ACID stats
Steve Yeom created HIVE-19412: - Summary: Possible invalid Full ACID stats Key: HIVE-19412 URL: https://issues.apache.org/jira/browse/HIVE-19412 Project: Hive Issue Type: Sub-task Affects Versions: 3.0.0 Reporter: Steve Yeom Fix For: 3.0.0 https://issues.apache.org/jira/browse/HIVE-19411?filter=-1 -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (HIVE-19411) Full-ACID table stats may not be valid. E.g., delete/insert
Steve Yeom created HIVE-19411: - Summary: Full-ACID table stats may not be valid. E.g., delete/insert Key: HIVE-19411 URL: https://issues.apache.org/jira/browse/HIVE-19411 Project: Hive Issue Type: Bug Components: Hive Affects Versions: 3.0.0 Reporter: Steve Yeom Fix For: 0.10.1 E.g., per Sergey,. updating a row can ended up +2 rows instead of +0 since it is translated to delete and insert and the physical writer may just add # of operations. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (HIVE-19364) autoColumnStats_10.q test results for TestMiniLlapLocalCliDriver with insert-only transactional table does not match those with non-transactional table
Steve Yeom created HIVE-19364: - Summary: autoColumnStats_10.q test results for TestMiniLlapLocalCliDriver with insert-only transactional table does not match those with non-transactional table Key: HIVE-19364 URL: https://issues.apache.org/jira/browse/HIVE-19364 Project: Hive Issue Type: Bug Components: Hive Affects Versions: 3.0.0 Reporter: Steve Yeom Assignee: Steve Yeom -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (HIVE-19330) multi_insert_partitioned.q fails with "src table does not exist" message.
Steve Yeom created HIVE-19330: - Summary: multi_insert_partitioned.q fails with "src table does not exist" message. Key: HIVE-19330 URL: https://issues.apache.org/jira/browse/HIVE-19330 Project: Hive Issue Type: Bug Components: Hive Affects Versions: 3.0.0 Reporter: Steve Yeom -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (HIVE-19327) qroupby_rollup_empty.q fails for insert-only transactional tables
Steve Yeom created HIVE-19327: - Summary: qroupby_rollup_empty.q fails for insert-only transactional tables Key: HIVE-19327 URL: https://issues.apache.org/jira/browse/HIVE-19327 Project: Hive Issue Type: Bug Components: Hive Affects Versions: 3.0.0 Reporter: Steve Yeom Fix For: 3.0.0 -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (HIVE-19280) Invalid error messages for UPDATE/DELETE on insert-only transactional tables
Steve Yeom created HIVE-19280: - Summary: Invalid error messages for UPDATE/DELETE on insert-only transactional tables Key: HIVE-19280 URL: https://issues.apache.org/jira/browse/HIVE-19280 Project: Hive Issue Type: Bug Components: Parser Affects Versions: 3.0.0 Reporter: Steve Yeom Assignee: Steve Yeom Fix For: 3.0.0 UPDATE/DELETE on MM tables fails with "FAILED: SemanticException Error 10297: Attempt to do update or delete on table tpch.tbl_default_mm that is not transactional". This is invalid since the MM table is transactional. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (HIVE-19221) DESC FORMATTED shows incorrect results in table statistics for full ACID table after multi table inserts
Steve Yeom created HIVE-19221: - Summary: DESC FORMATTED shows incorrect results in table statistics for full ACID table after multi table inserts Key: HIVE-19221 URL: https://issues.apache.org/jira/browse/HIVE-19221 Project: Hive Issue Type: Bug Components: Query Processor Affects Versions: 3.0.0 Reporter: Steve Yeom "DESC FORMATTED acid_table" seems to show incorrect table row count and COLUMN_STATS_ACCURATE item values after multi table inserts. I will add the test case shortly. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (HIVE-19186) Multi Table INSERT statements query have a flaw for partitioned table when INSERT INTO and INSERT OVERWRITE are used
Steve Yeom created HIVE-19186: - Summary: Multi Table INSERT statements query have a flaw for partitioned table when INSERT INTO and INSERT OVERWRITE are used Key: HIVE-19186 URL: https://issues.apache.org/jira/browse/HIVE-19186 Project: Hive Issue Type: Bug Components: Query Planning Affects Versions: 3.0.0 Reporter: Steve Yeom Fix For: 3.0.0 One problem test case is: create table intermediate(key int) partitioned by (p int) stored as orc; insert into table intermediate partition(p='455') select distinct key from src where key >= 0 order by key desc limit 2; insert into table intermediate partition(p='456') select distinct key from src where key is not null order by key asc limit 2; insert into table intermediate partition(p='457') select distinct key from src where key >= 100 order by key asc limit 2; from intermediate insert into table multi_partitioned partition(p=2) select p, key insert overwrite table multi_partitioned partition(p=1) select key, p; -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (HIVE-18999) Filter operator does not work for List
Steve Yeom created HIVE-18999:
-
Summary: Filter operator does not work for List
Key: HIVE-18999
URL: https://issues.apache.org/jira/browse/HIVE-18999
Project: Hive
Issue Type: Bug
Components: Query Processor
Affects Versions: 3.0.0
Reporter: Steve Yeom
The repro is from EAR-8093 , especially by [~jcamachorodriguez].
I have reproduced at the current master.
set hive.optimize.point.lookup=false;
create table table1(col0 int, col1 bigint, col2 string, col3 bigint, col4
bigint);
insert into table1 values (1, 1, 'ccl',2014, 11);
insert into table1 values (1, 1, 'ccl',2015, 11);
insert into table1 values (1, 1, 'ccl',2014, 11);
insert into table1 values (1, 1, 'ccl',2013, 11);
-- INCORRECT
SELECT COUNT(t1.col0) from table1 t1 where struct(col3, col4) in
(struct(2014,11));
-- CORRECT
SELECT COUNT(t1.col0) from table1 t1 where struct(col3, col4) in
(struct('2014','11'));
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Created] (HIVE-18693) TestTxnCommands2#writeBetweenWorkerAndCleaner fails on MM table
Steve Yeom created HIVE-18693: - Summary: TestTxnCommands2#writeBetweenWorkerAndCleaner fails on MM table Key: HIVE-18693 URL: https://issues.apache.org/jira/browse/HIVE-18693 Project: Hive Issue Type: Task Components: Transactions Reporter: Steve Yeom Assignee: Steve Yeom TestTxnCommands2#writeBetweenWorkerAndCleaner with minor changes (changing delete command to insert command) fails on MM table. Specifically the last SELECT commands returns wrong results. But this test works fine with full ACID table. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (HIVE-18619) Verification of temporary Micromanaged table atomicity is needed
Steve Yeom created HIVE-18619: - Summary: Verification of temporary Micromanaged table atomicity is needed Key: HIVE-18619 URL: https://issues.apache.org/jira/browse/HIVE-18619 Project: Hive Issue Type: Bug Components: Transactions Affects Versions: 3.0.0 Reporter: Steve Yeom Session based temporary table by HIVE-7090 had no consideration of Micromanaged table (MM) since there was no insert-only ACID table at its creation tije. HIVE-18599 addressed the issue of no writes during CTTAS (Create Temporary Table As Select) on Micro-Managed table. But atomicity of temporary MM table is not verified. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (HIVE-18618) Table stats on Micro-managed table becomes incorrect after INSERT OVERWRITE
Steve Yeom created HIVE-18618: - Summary: Table stats on Micro-managed table becomes incorrect after INSERT OVERWRITE Key: HIVE-18618 URL: https://issues.apache.org/jira/browse/HIVE-18618 Project: Hive Issue Type: Bug Components: Transactions Affects Versions: 3.0.0 Reporter: Steve Yeom Assignee: Steve Yeom Micromanage table INSERT OVERWRITE now does not clean existing delta directories during the operation. Instead compaction cleaner deletes obsolete directories. The current system does not compute correctly when it calculates table statistics since it does not ignore obsolete delta directories. A fix is already available in the patch of HIVE-18052. It would be valuable to separate the code changes into this jira ticket. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (HIVE-18599) CREATE TEMPORARY TABLE AS SELECT(CTTAS) on Micromanaged table does not write data
Steve Yeom created HIVE-18599:
-
Summary: CREATE TEMPORARY TABLE AS SELECT(CTTAS) on Micromanaged
table does not write data
Key: HIVE-18599
URL: https://issues.apache.org/jira/browse/HIVE-18599
Project: Hive
Issue Type: Bug
Components: Transactions
Affects Versions: 3.0.0
Reporter: Steve Yeom
CTTAS on temporary micromanaged table does not write data.
I.e., "SELECT * FROM ctas0_mm;" does not return any rows from the
below script:
set hive.mapred.mode=nonstrict;
set hive.explain.user=false;
set hive.fetch.task.conversion=none;
set tez.grouping.min-size=1;
set tez.grouping.max-size=2;
set hive.exec.dynamic.partition.mode=nonstrict;
set hive.support.concurrency=true;
set hive.txn.manager=org.apache.hadoop.hive.ql.lockmgr.DbTxnManager;
drop table intermediate;
create table intermediate(key int) partitioned by (p int) stored as orc;
insert into table intermediate partition(p='455') select distinct key from src
where key >= 0 order by key desc limit 2;
insert into table intermediate partition(p='456') select distinct key from src
where key is not null order by key asc limit 2;
insert into table intermediate partition(p='457') select distinct key from src
where key >= 100 order by key asc limit 2;
drop table ctas0_mm;
explain create temporary table ctas0_mm tblproperties ("transactional"="true",
"transactional_properties"="insert_only") as select * from intermediate;
create temporary table ctas0_mm tblproperties ("transactional"="true",
"transactional_properties"="insert_only") as select * from intermediate;
select * from ctas0_mm;
drop table ctas0_mm;
drop table intermediate;
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Created] (HIVE-18395) Using stats for aggregates on Acid/MM is off even with "hive.compute.query.using.stats" is true.
Steve Yeom created HIVE-18395: - Summary: Using stats for aggregates on Acid/MM is off even with "hive.compute.query.using.stats" is true. Key: HIVE-18395 URL: https://issues.apache.org/jira/browse/HIVE-18395 Project: Hive Issue Type: Bug Affects Versions: 3.0.0 Reporter: Steve Yeom Priority: Minor -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Created] (HIVE-18380) ALTER TABLE CONCATENATE is not supported on Micro-managed table
Steve Yeom created HIVE-18380: - Summary: ALTER TABLE CONCATENATE is not supported on Micro-managed table Key: HIVE-18380 URL: https://issues.apache.org/jira/browse/HIVE-18380 Project: Hive Issue Type: Bug Components: Transactions Affects Versions: 3.0.0 Reporter: Steve Yeom Priority: Minor ALTER TABLE CONCATENATE is not supported on Micro-managed table. Example qtest is "alter_merge_2_orc.q" and the unsupportability is revealed when we start with tables in micro-managed table type(insert_only transactional). -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Created] (HIVE-18379) ALTER TABLE authorization_part SET PROPERTIES ("PARTITIONL_LEVEL_PRIVILEGE"="TRUE"); fails when authorization_part is MicroManaged table.
Steve Yeom created HIVE-18379:
-
Summary: ALTER TABLE authorization_part SET PROPERTIES
("PARTITIONL_LEVEL_PRIVILEGE"="TRUE"); fails when authorization_part is
MicroManaged table.
Key: HIVE-18379
URL: https://issues.apache.org/jira/browse/HIVE-18379
Project: Hive
Issue Type: Bug
Components: Transactions
Affects Versions: 3.0.0
Reporter: Steve Yeom
Priority: Minor
ALTER TABLE authorization_part SET TBLPROPERTIES
("PARTITION_LEVEL_PRIVILEGE"="TRUE") fails when authorization_part is a
Micromanaged table.
This is from authorization_2.q qtest.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
[jira] [Created] (HIVE-18215) Possible code optimization exists for "INSERT OVERWITE on MM table. SELECT FROM (SELECT .. UNION ALL SELECT ..)
Steve Yeom created HIVE-18215: - Summary: Possible code optimization exists for "INSERT OVERWITE on MM table. SELECT FROM (SELECT .. UNION ALL SELECT ..) Key: HIVE-18215 URL: https://issues.apache.org/jira/browse/HIVE-18215 Project: Hive Issue Type: Bug Components: HiveServer2 Affects Versions: 3.0.0 Reporter: Steve Yeom Priority: Minor Fix For: 3.0.0 removeTempOrDuplicateFiles(.) has an opportunity for performance code optimization for the test case of "INSERT OVERWITE on MM table. SELECT FROM (SELECT .. UNION ALL SELECT ..)" from dp_counter_mm.q. This is MM table specific and we can avoid calling fs.exists() by creating a specific mmDirectories list for the current SELECT statement (out of two SELECTs in our test case from the dp_counter_mm.q) from the IOW union all query. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Created] (HIVE-18052) Run p-tests on mm tables
Steve Yeom created HIVE-18052: - Summary: Run p-tests on mm tables Key: HIVE-18052 URL: https://issues.apache.org/jira/browse/HIVE-18052 Project: Hive Issue Type: Task Reporter: Steve Yeom -- This message was sent by Atlassian JIRA (v6.4.14#64029)
