Re: Problem on carbondata quering performance tuning

2018-04-02 Thread BabuLal
Hi Thanks for using Carbondata. Based on Information you provided , Please try below solutions /Points. *A. Tune Resource Allocation * You have 55 core/NM , and given spark.executor.cores= 54 which means one NM will have only one Executor and total you will have only 4 Executor even

Re: Re: Getting [Problem in loading segment blocks] error after doing multi update operations

2018-03-30 Thread BabuLal
Hi yixu2001 Can you please verify your issue with PR https://github.com/apache/carbondata/pull/2097 . PR is for Branch 1.3 because you are using carbondata1.3 . Let me know if issue still exists. Thanks Babu -- Sent from:

Re: Re: Getting [Problem in loading segment blocks] error after doing multi update operations

2018-03-23 Thread BabuLal
Hi Issue is fixed and PR is raised. 1. PR :- https://github.com/apache/carbondata/pull/2097 2. Below situation is handled in PR a. Skip 0 byte deletedelta b. On OutputStream Close/flush if any error is thrown from hdfs (SpaceQuota/No Lease ..ect) then Exception was not thrown to

Re: Getting [Problem in loading segment blocks] error after doing multi update operations

2018-03-22 Thread BabuLal
hi all i am able to reproduce same exception in my cluster and got the same exception. (Trace is listed below) -- scala> carbon.sql("select count(*) from public.c_compact4").show 2018-03-22 20:40:33,105 | WARN | main | main spark.sql.sources.options.keys expected, but read nothing |

Re: Getting [Problem in loading segment blocks] error after doing multi update operations

2018-03-20 Thread BabuLal
Hi yixu2001 We have tried same code which is given in the below mail but not able to reproduce the same. Please find some of the analysis points 1. As per your Exception

Re: carbondata load all stored data to tmp dir

2018-03-13 Thread BabuLal
Hi dylan I have verified your scenario in my setup and it is working fine without downloading store to local /tmp/location . Below command is used to started Thriftserver & Carbon Store is NOT getting copied to /tmp location . bin/spark-submit --class

[jira] [Created] (CARBONDATA-1152) List partition not working properly

2017-06-09 Thread Babulal (JIRA)
Babulal created CARBONDATA-1152: --- Summary: List partition not working properly Key: CARBONDATA-1152 URL: https://issues.apache.org/jira/browse/CARBONDATA-1152 Project: CarbonData Issue Type