[jira] [Created] (CARBONDATA-1089) Unify block(driver) and blocklet(executor) side indexes.

2017-05-24 Thread Ravindra Pesala (JIRA)
Ravindra Pesala created CARBONDATA-1089: --- Summary: Unify block(driver) and blocklet(executor) side indexes. Key: CARBONDATA-1089 URL: https://issues.apache.org/jira/browse/CARBONDATA-1089

[jira] [Created] (CARBONDATA-1088) Minimize the driver side block index.

2017-05-24 Thread Ravindra Pesala (JIRA)
Ravindra Pesala created CARBONDATA-1088: --- Summary: Minimize the driver side block index. Key: CARBONDATA-1088 URL: https://issues.apache.org/jira/browse/CARBONDATA-1088 Project: CarbonData

[jira] [Created] (CARBONDATA-1087) Optimize block and blocklet index.

2017-05-24 Thread Ravindra Pesala (JIRA)
Ravindra Pesala created CARBONDATA-1087: --- Summary: Optimize block and blocklet index. Key: CARBONDATA-1087 URL: https://issues.apache.org/jira/browse/CARBONDATA-1087 Project: CarbonData

Re: [DISCUSS] Data loading improvement

2017-05-24 Thread Kumar Vishal
Hi All, Do we have some statistics about current bottlenecks which part is taking more time?? *@Ravindra* Please correct me If I am wrong I think our current unsafe sort is also in-place it is only swapping the offsets not data. Only from comparison it is getting the data from off-heap to

Re: SPARK update error

2017-05-24 Thread Pallavi Singh
Hi Sunerhan, CarbonData does not support access to data loaded with different versions of Spark i.e 2.1 and 1.6. On Wed, May 24, 2017 at 1:41 PM, sunerhan1...@sina.com < sunerhan1...@sina.com> wrote: > Changing version from spark2.1+carbon1.1.0 to spark1.6+carbon1.1.0 and > find out that data