[jira] [Commented] (CARBONDATA-4147) Carbondata 2.1.0 MV ERROR inserting data into table with MV
[
https://issues.apache.org/jira/browse/CARBONDATA-4147?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17307584#comment-17307584
]
Indhumathi Muthumurugesh commented on CARBONDATA-4147:
--
1. If you have installed carbon by taking release jars from
[https://carbondata.apache.org/] , you have to wait for carbon 2.1.1 release.
Issue fix will be given in this release.
2. If you have local Carbon Code setup, you can cherry-pick
[https://github.com/apache/carbondata/pull/4106] and build carbon jars. In
order to build carbon jars, you can refer
[https://github.com/apache/carbondata/blob/master/build/README.md]
> Carbondata 2.1.0 MV ERROR inserting data into table with MV
>
>
> Key: CARBONDATA-4147
> URL: https://issues.apache.org/jira/browse/CARBONDATA-4147
> Project: CarbonData
> Issue Type: Bug
> Components: core
>Affects Versions: 2.1.0
> Environment: Apache carbondata 2.1.0
>Reporter: Sushant Sammanwar
>Assignee: Indhumathi Muthumurugesh
>Priority: Major
> Labels: datatype,double, materializedviews
> Fix For: 2.1.1
>
> Attachments: carbondata_210_insert_error_stack-trace
>
> Time Spent: 3h 10m
> Remaining Estimate: 0h
>
> Hi Team ,
>
> We are working on a POC where we are using carbon 2.1.0.
> We have created below tables, MV :
> create table if not exists fact_365_1_eutrancell_21 (ts timestamp, metric
> STRING, tags_id STRING, value DOUBLE) partitioned by (ts2 timestamp) stored
> as carbondata TBLPROPERTIES ('SORT_COLUMNS'='metric')
> create materialized view if not exists fact_365_1_eutrancell_21_30_minute as
> select tags_id ,metric ,ts2, timeseries(ts,'thirty_minute') as
> ts,sum(value),avg(value),min(value),max(value) from fact_365_1_eutrancell_21
> group by metric, tags_id, timeseries(ts,'thirty_minute') ,ts2
>
> When i try to insert data into above Table, below error is thrown :
> scala> carbon.sql("insert into fact_365_1_eutrancell_21 values ('2020-09-25
> 05:30:00','eUtranCell.HHO.X2.InterFreq.PrepAttOut','ff6cb0f7-fba0-4134-81ee-55e820574627',392.2345,'2020-09-25
> 05:30:00')").show()
> 21/03/10 22:32:20 AUDIT audit: \{"time":"March 10, 2021 10:32:20 PM
> IST","username":"root","opName":"INSERT
> INTO","opId":"33474031950342736","opStatus":"START"}
> [Stage 0:> (0 + 1) / 1]21/03/10 22:32:32 WARN CarbonOutputIteratorWrapper:
> try to poll a row batch one more time.
> 21/03/10 22:32:32 WARN CarbonOutputIteratorWrapper: try to poll a row batch
> one more time.
> 21/03/10 22:32:32 WARN CarbonOutputIteratorWrapper: try to poll a row batch
> one more time.
> 21/03/10 22:32:36 WARN log: Updating partition stats fast for:
> fact_365_1_eutrancell_21
> 21/03/10 22:32:36 WARN log: Updated size to 2699
> 21/03/10 22:32:38 AUDIT audit: \{"time":"March 10, 2021 10:32:38 PM
> IST","username":"root","opName":"INSERT
> OVERWRITE","opId":"33474049863830951","opStatus":"START"}
> [Stage 3:==>(199 + 1) /
> 200]21/03/10 22:33:07 WARN CarbonOutputIteratorWrapper: try to poll a row
> batch one more time.
> 21/03/10 22:33:07 WARN CarbonOutputIteratorWrapper: try to poll a row batch
> one more time.
> 21/03/10 22:33:07 WARN CarbonOutputIteratorWrapper: try to poll a row batch
> one more time.
> 21/03/10 22:33:07 ERROR CarbonFactDataHandlerColumnar: Error in producer
> java.lang.ClassCastException: java.lang.Double cannot be cast to
> java.lang.Long
> at
> org.apache.carbondata.core.datastore.page.ColumnPage.putData(ColumnPage.java:402)
> at
> org.apache.carbondata.processing.store.TablePage.convertToColumnarAndAddToPages(TablePage.java:239)
> at
> org.apache.carbondata.processing.store.TablePage.addRow(TablePage.java:201)
> at
> org.apache.carbondata.processing.store.CarbonFactDataHandlerColumnar.processDataRows(CarbonFactDataHandlerColumnar.java:397)
> at
> org.apache.carbondata.processing.store.CarbonFactDataHandlerColumnar.access$500(CarbonFactDataHandlerColumnar.java:60)
> at
> org.apache.carbondata.processing.store.CarbonFactDataHandlerColumnar$Producer.call(CarbonFactDataHandlerColumnar.java:637)
> at
> org.apache.carbondata.processing.store.CarbonFactDataHandlerColumnar$Producer.call(CarbonFactDataHandlerColumnar.java:614)
> at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
> at java.lang.Thread.run(Thread.java:748)
>
>
> It seems the method is converting "decimal" data type of table to a "long"
> data type for MV.
> During value conversion it is throwing the error.
> Could you please check if this is a defect / bug
[jira] [Commented] (CARBONDATA-4147) Carbondata 2.1.0 MV ERROR inserting data into table with MV
[
https://issues.apache.org/jira/browse/CARBONDATA-4147?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17307581#comment-17307581
]
Sushant Sammanwar commented on CARBONDATA-4147:
---
[~Indhumathi27] How can i download and apply the fix ? Can you share it ?
> Carbondata 2.1.0 MV ERROR inserting data into table with MV
>
>
> Key: CARBONDATA-4147
> URL: https://issues.apache.org/jira/browse/CARBONDATA-4147
> Project: CarbonData
> Issue Type: Bug
> Components: core
>Affects Versions: 2.1.0
> Environment: Apache carbondata 2.1.0
>Reporter: Sushant Sammanwar
>Assignee: Indhumathi Muthumurugesh
>Priority: Major
> Labels: datatype,double, materializedviews
> Fix For: 2.1.1
>
> Attachments: carbondata_210_insert_error_stack-trace
>
> Time Spent: 3h 10m
> Remaining Estimate: 0h
>
> Hi Team ,
>
> We are working on a POC where we are using carbon 2.1.0.
> We have created below tables, MV :
> create table if not exists fact_365_1_eutrancell_21 (ts timestamp, metric
> STRING, tags_id STRING, value DOUBLE) partitioned by (ts2 timestamp) stored
> as carbondata TBLPROPERTIES ('SORT_COLUMNS'='metric')
> create materialized view if not exists fact_365_1_eutrancell_21_30_minute as
> select tags_id ,metric ,ts2, timeseries(ts,'thirty_minute') as
> ts,sum(value),avg(value),min(value),max(value) from fact_365_1_eutrancell_21
> group by metric, tags_id, timeseries(ts,'thirty_minute') ,ts2
>
> When i try to insert data into above Table, below error is thrown :
> scala> carbon.sql("insert into fact_365_1_eutrancell_21 values ('2020-09-25
> 05:30:00','eUtranCell.HHO.X2.InterFreq.PrepAttOut','ff6cb0f7-fba0-4134-81ee-55e820574627',392.2345,'2020-09-25
> 05:30:00')").show()
> 21/03/10 22:32:20 AUDIT audit: \{"time":"March 10, 2021 10:32:20 PM
> IST","username":"root","opName":"INSERT
> INTO","opId":"33474031950342736","opStatus":"START"}
> [Stage 0:> (0 + 1) / 1]21/03/10 22:32:32 WARN CarbonOutputIteratorWrapper:
> try to poll a row batch one more time.
> 21/03/10 22:32:32 WARN CarbonOutputIteratorWrapper: try to poll a row batch
> one more time.
> 21/03/10 22:32:32 WARN CarbonOutputIteratorWrapper: try to poll a row batch
> one more time.
> 21/03/10 22:32:36 WARN log: Updating partition stats fast for:
> fact_365_1_eutrancell_21
> 21/03/10 22:32:36 WARN log: Updated size to 2699
> 21/03/10 22:32:38 AUDIT audit: \{"time":"March 10, 2021 10:32:38 PM
> IST","username":"root","opName":"INSERT
> OVERWRITE","opId":"33474049863830951","opStatus":"START"}
> [Stage 3:==>(199 + 1) /
> 200]21/03/10 22:33:07 WARN CarbonOutputIteratorWrapper: try to poll a row
> batch one more time.
> 21/03/10 22:33:07 WARN CarbonOutputIteratorWrapper: try to poll a row batch
> one more time.
> 21/03/10 22:33:07 WARN CarbonOutputIteratorWrapper: try to poll a row batch
> one more time.
> 21/03/10 22:33:07 ERROR CarbonFactDataHandlerColumnar: Error in producer
> java.lang.ClassCastException: java.lang.Double cannot be cast to
> java.lang.Long
> at
> org.apache.carbondata.core.datastore.page.ColumnPage.putData(ColumnPage.java:402)
> at
> org.apache.carbondata.processing.store.TablePage.convertToColumnarAndAddToPages(TablePage.java:239)
> at
> org.apache.carbondata.processing.store.TablePage.addRow(TablePage.java:201)
> at
> org.apache.carbondata.processing.store.CarbonFactDataHandlerColumnar.processDataRows(CarbonFactDataHandlerColumnar.java:397)
> at
> org.apache.carbondata.processing.store.CarbonFactDataHandlerColumnar.access$500(CarbonFactDataHandlerColumnar.java:60)
> at
> org.apache.carbondata.processing.store.CarbonFactDataHandlerColumnar$Producer.call(CarbonFactDataHandlerColumnar.java:637)
> at
> org.apache.carbondata.processing.store.CarbonFactDataHandlerColumnar$Producer.call(CarbonFactDataHandlerColumnar.java:614)
> at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
> at java.lang.Thread.run(Thread.java:748)
>
>
> It seems the method is converting "decimal" data type of table to a "long"
> data type for MV.
> During value conversion it is throwing the error.
> Could you please check if this is a defect / bug or let me know if i have
> missed something ?
> Note : This was working in carbon 2.0.1
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
