Re: Dictionary file is locked for updation

2016-12-26 Thread Kumar Vishal
Hi, can you please find *"HDFS lock path"* string in executor log and let me know the complete log message. -Regards Kumar Vishal On Tue, Dec 27, 2016 at 12:45 PM, 251469031 <251469...@qq.com> wrote: > Hi all, > > > when I run the following script: > scala> cc.sql(s"load data inpath

Re: Int accepting range of BigInt

2016-12-26 Thread Kumar Vishal
Hi Anurag, Carbon has value based compression for storing the measure column data, in store it will be stored as int. I think only the bug is in desc table as we are updating the data type in schmea. My query is that to resolve the issue of out of range values being accepted for Int, should we be

Re: Int accepting range of BigInt

2016-12-26 Thread Anurag Srivastava
Hello Raghu, We can not validate data on the basis of schema because when we give "Int" data type it stores in schema as a "BigInt" data type and then it starts taking range of "BigInt". When we provide "BigInt" data type, it also stores as a "BigInt". That time it will not be possible to

[jira] [Created] (CARBONDATA-567) Change integration test cases under integration/spark to work on cluster

2016-12-26 Thread Rahul Kumar (JIRA)
Rahul Kumar created CARBONDATA-567: -- Summary: Change integration test cases under integration/spark to work on cluster Key: CARBONDATA-567 URL: https://issues.apache.org/jira/browse/CARBONDATA-567

Dictionary file is locked for updation

2016-12-26 Thread 251469031
Hi all, when I run the following script: scala> cc.sql(s"load data inpath 'hdfs://master:9000/carbondata/sample.csv' into table test_table") it turns out that: WARN 27-12 12:37:58,044 - Lost task 1.3 in stage 2.0 (TID 13, slave1): java.lang.RuntimeException: Dictionary file name is locked

[jira] [Created] (CARBONDATA-566) clean up code for carbon-spark2 module

2016-12-26 Thread Jacky Li (JIRA)
Jacky Li created CARBONDATA-566: --- Summary: clean up code for carbon-spark2 module Key: CARBONDATA-566 URL: https://issues.apache.org/jira/browse/CARBONDATA-566 Project: CarbonData Issue Type:

[jira] [Created] (CARBONDATA-565) Clean up code

2016-12-26 Thread Jacky Li (JIRA)
Jacky Li created CARBONDATA-565: --- Summary: Clean up code Key: CARBONDATA-565 URL: https://issues.apache.org/jira/browse/CARBONDATA-565 Project: CarbonData Issue Type: Improvement

Re: the storepath in carbon.properties seems not work

2016-12-26 Thread Jay
hi, do u configure right carbon.properties file path in spark-default.conf? or please share your spark-default.conf file. regards Jay -- Original -- From: "251469031";<251469...@qq.com>; Date: Mon, Dec 26, 2016 05:44 PM To:

Re: Int accepting range of BigInt

2016-12-26 Thread Raghunandan S
Dear anurag, Not required to be stored as int.if we validate the data based on the schema definition would suffice On Mon, 26 Dec 2016 at 1:10 PM, Anurag Srivastava wrote: > Hello everyone, > > I am working on resolving jira bug >

Re: [Discussion]Simplify the deployment of carbondata

2016-12-26 Thread Raghunandan S
I suggest we have a parallel implementation by removing kettle and when it stabilises we make kettle deprecated and then remove it On Mon, 26 Dec 2016 at 1:25 PM, Liang Chen wrote: > Hi > > Thanks you started a good discussion. > > For 1 and 2, i agree. In 1.0.0

[jira] [Created] (CARBONDATA-564) long time ago, carbon may use dimension table csv file to make dictionary, but now unsed, so remove

2016-12-26 Thread Jay (JIRA)
Jay created CARBONDATA-564: -- Summary: long time ago, carbon may use dimension table csv file to make dictionary, but now unsed, so remove Key: CARBONDATA-564 URL: https://issues.apache.org/jira/browse/CARBONDATA-564

[GitHub] incubator-carbondata-site pull request #4: Website Version 1

2016-12-26 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/incubator-carbondata-site/pull/4 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if

[GitHub] incubator-carbondata-site pull request #4: Website Version 1

2016-12-26 Thread PallaviSingh1992
GitHub user PallaviSingh1992 opened a pull request: https://github.com/apache/incubator-carbondata-site/pull/4 Website Version 1 You can merge this pull request into a Git repository by running: $ git pull https://github.com/PallaviSingh1992/incubator-carbondata-site

[GitHub] incubator-carbondata-site pull request #3: Website Version 1.0

2016-12-26 Thread PallaviSingh1992
Github user PallaviSingh1992 closed the pull request at: https://github.com/apache/incubator-carbondata-site/pull/3 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] incubator-carbondata-site pull request #3: Website Version 1.0

2016-12-26 Thread PallaviSingh1992
GitHub user PallaviSingh1992 opened a pull request: https://github.com/apache/incubator-carbondata-site/pull/3 Website Version 1.0 You can merge this pull request into a Git repository by running: $ git pull https://github.com/PallaviSingh1992/incubator-carbondata-site

the storepath in carbon.properties seems not work

2016-12-26 Thread 251469031
Hi all: I'm now configing carbondata in cluster mode, and some configurations in the file carbon.properties are as bellow: carbon.storelocation=hdfs://master:9000/carbondata carbon.ddl.base.hdfs.url=hdfs://master:9000/carbondata/data