[jira] [Commented] (CARBONDATA-2540) MV Dataset - Unionall queries are not fetching data from MV dataset.

2018-08-01 Thread Prasanna Ravichandran (JIRA)


[ 
https://issues.apache.org/jira/browse/CARBONDATA-2540?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16565129#comment-16565129
 ] 

Prasanna Ravichandran commented on CARBONDATA-2540:
---

Validation added. Closed.

*Terminal:*

> create datamap mv_unional using 'mv' as Select Z.empno From (Select 
> empno,empname From fact_table1 Union All Select empno,empname from 
> fact_table2) As Z Group By Z.empno;
*Error: java.lang.UnsupportedOperationException: MV is not supported for this 
query (state=,code=0)*

> MV Dataset - Unionall queries are not fetching data from MV dataset.
> 
>
> Key: CARBONDATA-2540
> URL: https://issues.apache.org/jira/browse/CARBONDATA-2540
> Project: CarbonData
>  Issue Type: Bug
>  Components: data-query
>Reporter: Prasanna Ravichandran
>Assignee: Ravindra Pesala
>Priority: Minor
>  Labels: Carbondata, MV, Materialistic_Views
> Fix For: 1.5.0, 1.4.1
>
> Attachments: data_mv.csv
>
>  Time Spent: 5h 10m
>  Remaining Estimate: 0h
>
> Unionall queries are not fetching data from MV dataset. 
> Test queries:
> scala> carbon.sql("drop table if exists fact_table1").show(200,false)
> ++
> ||
> ++
> ++
> scala> carbon.sql("CREATE TABLE fact_table1 (empno int, empname String, 
> designation String, doj Timestamp,workgroupcategory int, 
> workgroupcategoryname String, deptno int, deptname String,projectcode int, 
> projectjoindate Timestamp, projectenddate Timestamp,attendance 
> int,utilization int,salary int)STORED BY 
> 'org.apache.carbondata.format'").show(200,false)
> ++
> ||
> ++
> ++
> scala> carbon.sql("LOAD DATA local inpath 
> 'hdfs://hacluster/user/prasanna/data_mv.csv' INTO TABLE fact_table1 
> OPTIONS('DELIMITER'= ',', 'QUOTECHAR'= 
> '"','timestampformat'='dd-MM-')").show(200,false)
> ++
> ||
> ++
> ++
> scala> carbon.sql("LOAD DATA local inpath 
> 'hdfs://hacluster/user/prasanna/data_mv.csv' INTO TABLE fact_table1 
> OPTIONS('DELIMITER'= ',', 'QUOTECHAR'= 
> '\"','timestampformat'='dd-MM-')").show(200,false)
> ++
> ||
> ++
> ++
> scala> carbon.sql("drop table if exists fact_table2").show(200,false)
> ++
> ||
> ++
> ++
> scala> carbon.sql("CREATE TABLE fact_table2 (empno int, empname String, 
> designation String, doj Timestamp,workgroupcategory int, 
> workgroupcategoryname String, deptno int, deptname String,projectcode int, 
> projectjoindate Timestamp, projectenddate Timestamp,attendance 
> int,utilization int,salary int)STORED BY 
> 'org.apache.carbondata.format'").show(200,false)
> ++
> ||
> ++
> ++
> scala> carbon.sql("LOAD DATA local inpath 
> 'hdfs://hacluster/user/prasanna/data_mv.csv' INTO TABLE fact_table2 
> OPTIONS('DELIMITER'= ',', 'QUOTECHAR'= 
> '\"','timestampformat'='dd-MM-')").show(200,false)
> ++
> ||
> ++
> ++
> scala> carbon.sql("LOAD DATA local inpath 
> 'hdfs://hacluster/user/prasanna/data_mv.csv' INTO TABLE fact_table2 
> OPTIONS('DELIMITER'= ',', 'QUOTECHAR'= 
> '\"','timestampformat'='dd-MM-')").show(200,false)
> ++
> ||
> ++
> ++
>  
> scala> carbon.sql("create datamap mv_unional using 'mv' as Select Z.empno 
> From (Select empno,empname From fact_table1 Union All Select empno,empname 
> from fact_table2) As Z Group By Z.empno").show(200,false)
> ++
> ||
> ++
> ++
>  
> scala> carbon.sql("rebuild datamap mv_unional").show()
> ++
> ||
> ++
> ++
> scala> carbon.sql("explain Select Z.empno From (Select empno,empname From 
> fact_table1 Union All Select empno,empname from fact_table2) As Z Group By 
> Z.empno").show(200,false)
> +---

[jira] [Commented] (CARBONDATA-2540) MV Dataset - Unionall queries are not fetching data from MV dataset.

2018-07-09 Thread Ravindra Pesala (JIRA)


[ 
https://issues.apache.org/jira/browse/CARBONDATA-2540?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16536758#comment-16536758
 ] 

Ravindra Pesala commented on CARBONDATA-2540:
-

Union is not supported for mv queries, will add validation while creating mv

> MV Dataset - Unionall queries are not fetching data from MV dataset.
> 
>
> Key: CARBONDATA-2540
> URL: https://issues.apache.org/jira/browse/CARBONDATA-2540
> Project: CarbonData
>  Issue Type: Bug
>  Components: data-query
>Reporter: Prasanna Ravichandran
>Priority: Minor
>  Labels: Carbondata, MV, Materialistic_Views
> Attachments: data_mv.csv
>
>
> Unionall queries are not fetching data from MV dataset. 
> Test queries:
> scala> carbon.sql("drop table if exists fact_table1").show(200,false)
> ++
> ||
> ++
> ++
> scala> carbon.sql("CREATE TABLE fact_table1 (empno int, empname String, 
> designation String, doj Timestamp,workgroupcategory int, 
> workgroupcategoryname String, deptno int, deptname String,projectcode int, 
> projectjoindate Timestamp, projectenddate Timestamp,attendance 
> int,utilization int,salary int)STORED BY 
> 'org.apache.carbondata.format'").show(200,false)
> ++
> ||
> ++
> ++
> scala> carbon.sql("LOAD DATA local inpath 
> 'hdfs://hacluster/user/prasanna/data_mv.csv' INTO TABLE fact_table1 
> OPTIONS('DELIMITER'= ',', 'QUOTECHAR'= 
> '"','timestampformat'='dd-MM-')").show(200,false)
> ++
> ||
> ++
> ++
> scala> carbon.sql("LOAD DATA local inpath 
> 'hdfs://hacluster/user/prasanna/data_mv.csv' INTO TABLE fact_table1 
> OPTIONS('DELIMITER'= ',', 'QUOTECHAR'= 
> '\"','timestampformat'='dd-MM-')").show(200,false)
> ++
> ||
> ++
> ++
> scala> carbon.sql("drop table if exists fact_table2").show(200,false)
> ++
> ||
> ++
> ++
> scala> carbon.sql("CREATE TABLE fact_table2 (empno int, empname String, 
> designation String, doj Timestamp,workgroupcategory int, 
> workgroupcategoryname String, deptno int, deptname String,projectcode int, 
> projectjoindate Timestamp, projectenddate Timestamp,attendance 
> int,utilization int,salary int)STORED BY 
> 'org.apache.carbondata.format'").show(200,false)
> ++
> ||
> ++
> ++
> scala> carbon.sql("LOAD DATA local inpath 
> 'hdfs://hacluster/user/prasanna/data_mv.csv' INTO TABLE fact_table2 
> OPTIONS('DELIMITER'= ',', 'QUOTECHAR'= 
> '\"','timestampformat'='dd-MM-')").show(200,false)
> ++
> ||
> ++
> ++
> scala> carbon.sql("LOAD DATA local inpath 
> 'hdfs://hacluster/user/prasanna/data_mv.csv' INTO TABLE fact_table2 
> OPTIONS('DELIMITER'= ',', 'QUOTECHAR'= 
> '\"','timestampformat'='dd-MM-')").show(200,false)
> ++
> ||
> ++
> ++
>  
> scala> carbon.sql("create datamap mv_unional using 'mv' as Select Z.empno 
> From (Select empno,empname From fact_table1 Union All Select empno,empname 
> from fact_table2) As Z Group By Z.empno").show(200,false)
> ++
> ||
> ++
> ++
>  
> scala> carbon.sql("rebuild datamap mv_unional").show()
> ++
> ||
> ++
> ++
> scala> carbon.sql("explain Select Z.empno From (Select empno,empname From 
> fact_table1 Union All Select empno,empname from fact_table2) As Z Group By 
> Z.empno").show(200,false)
> +