Babulal created CARBONDATA-2530:
-----------------------------------
Summary: [MV] Wrong data displayed when parent table data are
loaded
Key: CARBONDATA-2530
URL: https://issues.apache.org/jira/browse/CARBONDATA-2530
Project: CarbonData
Issue Type: Bug
Reporter: Babulal
Spark Release:- Spark2.2.1
Create table and load data to it
create MV
rebuild datamap
run query (used during mv creation) which hits MV and get data
Now load data to main table
again run query (used during mv creation) which hits MV and get data
Result:- data shown is from MV which is wrong if increament load happens then
data should get from Main table(parent table)
Commands
0: jdbc:hive2://10.18.222.231:23040> create table tt13 ( name string, age int)
stored by 'carbondata';
0: jdbc:hive2://10.18.222.231:23040> insert into tt13 select 'babu',12;
+---------+--+
| Result |
+---------+--+
+---------+–+
0: jdbc:hive2://10.18.222.231:23040> create datamap datamap43 using 'mv' as
select name from tt13 ;
+---------+--+
| Result |
+---------+--+
+---------+--+
No rows selected (0.51 seconds)
0: jdbc:hive2://10.18.222.231:23040> rebuild datamap datamap43;
+---------+--+
| Result |
+---------+--+
+---------+--+
No rows selected (8.747 seconds)
0: jdbc:hive2://10.18.222.231:23040> explain select name from tt13;
+------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+--+
| plan |
+------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+--+
| == CarbonData Profiler ==
Table Scan on datamap43_table
- total blocklets: 1
- filter: none
- pruned by Main DataMap
- skipped blocklets: 0
|
| == Physical Plan ==
*BatchedScan CarbonDatasourceHadoopRelation [ Database name :default, Table
name :datamap43_table, Schema
:Some(StructType(StructField(tt13_name,StringType,true))) ]
default.datamap43_table[tt13_name#1311] |
+------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+--+
2 rows selected (0.525 seconds)
0: jdbc:hive2://10.18.222.231:23040> select name from tt13;
+------------+--+
| tt13_name |
+------------+--+
| babu |
+------------+--+
1 row selected (0.483 seconds)
0: jdbc:hive2://10.18.222.231:23040> insert into tt13 select 'lal',13;
+---------+--+
| Result |
+---------+--+
+---------+--+
No rows selected (11.819 seconds)
0: jdbc:hive2://10.18.222.231:23040> select name from tt13;
+------------+--+
| tt13_name |
+------------+--+
| babu |
+------------+--+
1 row selected (0.349 seconds)
0: jdbc:hive2://10.18.222.231:23040> explain select name from tt13;
+------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+--+
| plan |
+------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+--+
| == CarbonData Profiler ==
Table Scan on datamap43_table
- total blocklets: 1
- filter: none
- pruned by Main DataMap
- skipped blocklets: 0
|
| == Physical Plan ==
*BatchedScan CarbonDatasourceHadoopRelation [ Database name :default, Table
name :datamap43_table, Schema
:Some(StructType(StructField(tt13_name,StringType,true))) ]
default.datamap43_table[tt13_name#1311] |
+------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+--+
2 rows selected (0.391 seconds)
Expected
output should display 2 records . (check insert into command)
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)