Re: [Discussion] Support Spark/Hive based partition in carbon

2017-11-27 Thread cenyuhai11
The datasource api still have a problem that it do not support hybird fileformat table. Detail description about hybird fileformat table is in this issue: https://issues.apache.org/jira/browse/CARBONDATA-1377. All partitions' fileformat of datasource table must be the same. So we can't change fil

Re: carbondata unsupported type: StructType when use dataframe load data

2017-11-16 Thread cenyuhai11
I think we should add unit tests for all supported data types... Many data types are unavailable... -- Sent from: http://apache-carbondata-dev-mailing-list-archive.1130556.n5.nabble.com/

[DISCUSSION] Improve insert process

2017-10-26 Thread cenyuhai11
When I insert data into carbondata from one table, I should do as the following: 1、select count(1) from table1 and then 2、insert into table table1 select * from table1 Why I should execute "select count(1) from table1" first? because the number of tasks are compute by carbondata, it is releated to

Re: [DISCUSSION] Apache CarbonData 1.3.0 scope

2017-10-10 Thread cenyuhai11
Hi, Liang: Can I add one feature: 6) Hive integration (bring carbondata to data warehouse) -- Sent from: http://apache-carbondata-dev-mailing-list-archive.1130556.n5.nabble.com/