You can check as following and show the result.
1)
select * from test limit 1
2)
show segments for table test limit 1000
3)
alter table test compact 'major'
Better to provide more log info.
--
View this message in context:
Yes, it is not working because the support is not yet added, right now it
is low priority task as user can directly use spark-shell to create
carbonsession and execute the queries.
On 4 January 2017 at 12:40, anubhavtarar wrote:
> carbon shell is not working with spark
see these logs
jdbc:hive2://localhost:1> CREATE TABLE Bug2217559156(int int)USING
org.apache.spark.sql.CarbonSource;
+-+--+
| Result |
+-+--+
+-+--+
No rows selected (1.809 seconds)
it does not give any exception in any query most of the times but sometimes
it works
For Spark 2, when using SparkSession to create carbon table, need tableName
option to create carbon schema in store location folder. Better to use
CarbonSession to create carbon table now.
--
View this message in context:
I think you can have a look this maillist.
http://apache-carbondata-mailing-list-archive.1130556.n5.nabble.com/Dictionary-file-is-locked-for-updation-td5076.html
Have a look the following guide and pay attention to carbon.properties file.
hello,1,2 is ok ,3 throw error
--
View this message in context:
http://apache-carbondata-mailing-list-archive.1130556.n5.nabble.com/carbontable-compact-throw-err-tp5382p5430.html
Sent from the Apache CarbonData Mailing List archive mailing list archive at
Nabble.com.
carbon thrift server is not parsing carbon query randomly with spark 2
here are the logs
: jdbc:hive2://localhost:1> CREATE TABLE Bug221755915(int int)USING
org.apache.spark.sql.CarbonSource;
+-+--+
| Result |
+-+--+
+-+--+
No rows selected (0.216 seconds)
can
why there is table name option in carbon source format when we are alreday
giving table name with create table command
here are the logs
0: jdbc:hive2://localhost:1> CREATE TABLE testing2(String string)USING
org.apache.spark.sql.CarbonSource OPTIONS("bucketnumber"="1",
anubhav tarar created CARBONDATA-587:
Summary: Able to use reserved keyword in Carbon Table Commands
Key: CARBONDATA-587
URL: https://issues.apache.org/jira/browse/CARBONDATA-587
Project:
Hello:
in spark shell ,from carbonconext
cc.sql("ALTER TABLE test COMPACT 'MINOR'")
error happend.
how to sloved it ?
7/01/03 18:52:32 INFO CarbonDataRDDFactory$: main Acquired the compaction
lock for table test
17/01/03 18:52:32 INFO CarbonDataRDDFactory$: main loads identified for
merge is 0
carbon shell is not working with spark 2.0 version
here are the logs
java.lang.ClassNotFoundException: org.apache.spark.repl.carbon.Main
at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
at
ya but if user wanted to create table using carbon session and there is a
option of using tableName it is a kind of bug plus table name in options
also allow to create table with spaces see logs
CREATE TABLE Bug212(int string)USING org.apache.spark.sql.CarbonSource
OPTIONS("bucketnumber"="1",
Jihong MA created CARBONDATA-588:
Summary: cleanup WriterCompressModel
Key: CARBONDATA-588
URL: https://issues.apache.org/jira/browse/CARBONDATA-588
Project: CarbonData
Issue Type:
here is the script ./bin/spark-submit --conf
spark.sql.hive.thriftServer.singleSession=true --class
org.apache.carbondata.spark.thriftserver.CarbonThriftServer
/opt/spark-2.0.0-bin-hadoop2.7/carbonlib/carbondata_2.11-1.0.0-incubating-SNAPSHOT-shade-hadoop2.2.0.jar
anubhav tarar created CARBONDATA-589:
Summary: carbon spark shell is not working with spark 2.0
Key: CARBONDATA-589
URL: https://issues.apache.org/jira/browse/CARBONDATA-589
Project: CarbonData
have a look at these logs
CREATE TABLE Bug212(int string)USING org.apache.spark.sql.CarbonSource
OPTIONS("bucketnumber"="1", "bucketcolumns"="String","tableName"="t100");
Error:
org.apache.carbondata.spark.exception.MalformedCarbonCommandException: Table
default.t 100 can not be created without
16 matches
Mail list logo