Fw:carbonthriftserver can not be load many times

2017-09-12 Thread dylan
Forwarding messages From: "dylan" Date: 2017-09-12 16:25:56 To: user Subject: carbonthriftserver can not be load many times hello : when i use carbondata,i use step by 1.create table and load data 2.use carbonthriftserver,select * from t

Re: Fw:carbonthriftserver can not be load many times

2017-09-13 Thread dylan
hello ravipesala: thanks for your reply, i am use carbondata:1.1.0,spark:1.6.0. and I reproduce in accordance with the official quick-start-guide case again, 1.Creating a Table cc.sql("create table IF NOT EXISTS carbondb.test_table(id string,name String,city String,age int) stored

Re: Fw:carbonthriftserver can not be load many times

2017-09-13 Thread dylan
hello ravipesala: thanks for your reply, i am use carbondata version is 1.1.0 and spark version is 1.6.0. and I reproduce in accordance with the official quick-start-guide case again, 1.Creating a Table cc.sql("create table IF NOT EXISTS carbondb.test_table(id string,name String,c

Re: Fw:carbonthriftserver can not be load many times

2017-09-15 Thread dylan
hi Ravi : in my case,1,2,5 and 6 step is hone session on spark-shell ,4 and 7 is one session on beeline, According to your Suggest,i test this case on the current master branch, when i use beeline there is no Btree load failed info,but in my table there is no data,All the data is null. but i

carbondata unsupported type: StructType when use dataframe load data

2017-11-14 Thread dylan
when i load data from dataframe,i get error: java.lang.RuntimeException: unsupported type: StructType(StructField(double,DoubleType,false), StructField(decimal,DecimalType(9,2),false), StructField(string,StringType,false)) at scala.sys.package$.error(package.scala:27) at org.apache.

sparksql query result is not same as persto on same sql

2017-12-01 Thread dylan
hello all: i am use carbondata version is 1.2.0 and spark version is 1.6.0. in my test case 1.Creating a Table cc.sql("create table IF NOT EXISTS test.table5(id string,name String,city String,age int) stored by 'carbondata' * tblproperties('DICTIONARY_INCLUDE' = 'age')* ") 2

carbondata with presto unsupported Complex Types

2017-12-07 Thread dylan
hello all: i find presto unsupported Complex Types when using carbondata, on hive table,desc table like this : Column |Type | Extra | Comment ---+-

Re: carbondata with presto unsupported Complex Types

2017-12-11 Thread dylan
hi anubhavtarar: thanks for you reply Do you have plans to support complex types, although not commonly used, but sometimes it is necessary. -- Sent from: http://apache-carbondata-dev-mailing-list-archive.1130556.n5.nabble.com/

ERROR sortdata.SortTempFileChunkHolder when loading data

2018-01-02 Thread dylan
hello all: when i loading data on carbondata1.2,spark1.6 on yarn, i get this error: 18/01/02 17:27:25 INFO sortdata.SortDataRows: pool-24-thread-1 Time taken to sort and write sort temp file /hadoop7/yarn/nm/usercache/dba/appcache/application_1513058773052_20157/container_e38_1513058773052_201

carbondata load all stored data to tmp dir

2018-03-12 Thread dylan
hi guys: i am use carbondata1.3 and spark2.2.1 on standalone, i start the CarbonThriftServer like this: /bin/spark-submit --class org.apache.carbondata.spark.thriftserver.CarbonThriftServer $SPARK_HOME/carbonlib/carbondata_2.11-1.3.0-shade-hadoop2.7.2.jar hdfs://nameservice1/hive/car

Re: carbondata load all stored data to tmp dir

2018-03-13 Thread dylan
hello babulal: thanks for your reply. 1.my spark-default.conf is: spark.executor.extraJavaOptions -Dcarbon.properties.filepath=/home/spark-2.2.1-bin-hadoop2.7/conf/carbon.properties spark.driver.extraJavaOptions -Dcarbon.properties.filepath=/home/spark-2.2.1-bin-

Re: carbondata load all stored data to tmp dir

2018-03-13 Thread dylan
hello babulal: I know the problem,i use the wrong command to start spark-submit with --jars. Thank you very much for your answer and solved my problem. thanks! -- Sent from: http://apache-carbondata-dev-mailing-list-archive.1130556.n5.nabble.com/