Re: CarbonData Performance Optimization

2018-09-26 Thread Jacky Li
+1 > 在 2018年9月21日,上午10:20,Ravindra Pesala 写道: > > Hi, > > In case of querying data using Spark or Presto, carbondata is not well > optimized for reading data and fill the vector. The major issues are as > follows. > 1. CarbonData has long method stack for reading and filling out the data to >

Re: [ANNOUNCE] Raghunandan as new committer of Apache CarbonData

2018-09-26 Thread Raghunandan S
Thank you all. On Thu, 27 Sep 2018, 7:46 am Lu Cao, wrote: > Congrats Raghu! > > Regards, > Lionel > > On Wed, Sep 26, 2018 at 10:57 PM Jean-Baptiste Onofré > wrote: > > > Welcome aboard ! > > > > Congrats > > > > Regards > > JB > > > > Le 26 sept. 2018 à 10:45, à 10:45, xm_zzc

Re: [Issue] Load auto compaction failed

2018-09-26 Thread Raghunandan S
Dear Aaron, The memory requirements for local dictionary are high when compared to global dictionary.what are the offheap configuration values? I guess low values might be the reason Regards Raghu On Thu, 27 Sep 2018, 4:58 am aaron, <949835...@qq.com> wrote: > Hi community, > > Based on 1.5.0 -

[Issue] Load auto compaction failed

2018-09-26 Thread aaron
Hi community, Based on 1.5.0 - the load with local dictionary and local sort, the load failed when data count arrive 0.5 billion, but I've already load 50billion before with global dictionary and sort. Do you have any ideas? 18/09/26 08:39:45 AUDIT CarbonTableCompactor:

[Serious Issue] Rows disappeared

2018-09-26 Thread aaron
Hi Community, It seems that rows disappeared, same query get different result carbon.time(carbon.sql( s""" |EXPLAIN SELECT date, market_code, device_code, country_code, category_id, product_id, est_free_app_download, est_paid_app_download, est_revenue |FROM store

Re: Issues about dictionary and S3

2018-09-26 Thread aaron
Thanks, I've check already and it works well! Very impressive quick response ! -- Sent from: http://apache-carbondata-dev-mailing-list-archive.1130556.n5.nabble.com/

Re: [ANNOUNCE] Raghunandan as new committer of Apache CarbonData

2018-09-26 Thread Jean-Baptiste Onofré
Welcome aboard ! Congrats Regards JB Le 26 sept. 2018 à 10:45, à 10:45, xm_zzc <441586...@qq.com> a écrit: >Congratulations Raghunandan, welcome aboard !! > > > >-- >Sent from: >http://apache-carbondata-dev-mailing-list-archive.1130556.n5.nabble.com/

Re: [VOTE] Apache CarbonData 1.5.0(RC1) release

2018-09-26 Thread xm_zzc
Hi: Can this release include PR-2733: Upgrade presto integration version to 0.210? -- Sent from: http://apache-carbondata-dev-mailing-list-archive.1130556.n5.nabble.com/

Re: [ANNOUNCE] Raghunandan as new committer of Apache CarbonData

2018-09-26 Thread xm_zzc
Congratulations Raghunandan, welcome aboard !! -- Sent from: http://apache-carbondata-dev-mailing-list-archive.1130556.n5.nabble.com/

Re: [VOTE] Apache CarbonData 1.5.0(RC1) release

2018-09-26 Thread Jacky Li
There is a bug related to global dictionary reported by Aaron in the maillist, I suggest include this bug fix in this version. Regards, Jacky > 在 2018年9月26日,下午1:52,Ravindra Pesala 写道: > > Hi > > I submit the Apache CarbonData 1.5.0 (RC1) for your vote. > > 1.Release Notes: >

Re: [ANNOUNCE] Raghunandan as new committer of Apache CarbonData

2018-09-26 Thread manish gupta
Congratulations Raghunandan On Wed, 26 Sep 2018 at 1:07 PM, Kunal Kapoor wrote: > Congratulations raghunandan > > On Wed, Sep 26, 2018, 1:04 PM Ravindra Pesala > wrote: > > > Congrats Raghu > > > > On Wed, 26 Sep 2018 at 12:53, sujith chacko > > > wrote: > > > > > Congratulations Raghu > > >

Re: [ANNOUNCE] Raghunandan as new committer of Apache CarbonData

2018-09-26 Thread Kunal Kapoor
Congratulations raghunandan On Wed, Sep 26, 2018, 1:04 PM Ravindra Pesala wrote: > Congrats Raghu > > On Wed, 26 Sep 2018 at 12:53, sujith chacko > wrote: > > > Congratulations Raghu > > > > On Wed, 26 Sep 2018 at 12:44 PM, Rahul Kumar > > wrote: > > > > > congrats Raghunandan !! > > > > > >

Re: [ANNOUNCE] Raghunandan as new committer of Apache CarbonData

2018-09-26 Thread Ravindra Pesala
Congrats Raghu On Wed, 26 Sep 2018 at 12:53, sujith chacko wrote: > Congratulations Raghu > > On Wed, 26 Sep 2018 at 12:44 PM, Rahul Kumar > wrote: > > > congrats Raghunandan !! > > > > > > Rahul Kumar > > *Sr. Software Consultant* > > *Knoldus Inc.* > > m: 9555480074 > > w: www.knoldus.com

Re: [ANNOUNCE] Raghunandan as new committer of Apache CarbonData

2018-09-26 Thread sujith chacko
Congratulations Raghu On Wed, 26 Sep 2018 at 12:44 PM, Rahul Kumar wrote: > congrats Raghunandan !! > > > Rahul Kumar > *Sr. Software Consultant* > *Knoldus Inc.* > m: 9555480074 > w: www.knoldus.com e: rahul.ku...@knoldus.in > > > > On Wed, Sep 26, 2018 at 12:41 PM

Re: [ANNOUNCE] Raghunandan as new committer of Apache CarbonData

2018-09-26 Thread Rahul Kumar
congrats Raghunandan !! Rahul Kumar *Sr. Software Consultant* *Knoldus Inc.* m: 9555480074 w: www.knoldus.com e: rahul.ku...@knoldus.in On Wed, Sep 26, 2018 at 12:41 PM Kumar Vishal wrote: > Congratulations Raghunandan. > > -Regards > Kumar Vishal > > On Wed, Sep 26,

Re: [ANNOUNCE] Raghunandan as new committer of Apache CarbonData

2018-09-26 Thread Kumar Vishal
Congratulations Raghunandan. -Regards Kumar Vishal On Wed, Sep 26, 2018 at 12:36 PM Liang Chen wrote: > Hi all > > We are pleased to announce that the PMC has invited Raghunandan as new > committer of Apache CarbonData, and the invite has been accepted! > > Congrats to Raghunandan and welcome

[ANNOUNCE] Raghunandan as new committer of Apache CarbonData

2018-09-26 Thread Liang Chen
Hi all We are pleased to announce that the PMC has invited Raghunandan as new committer of Apache CarbonData, and the invite has been accepted! Congrats to Raghunandan and welcome aboard. Regards Apache CarbonData PMC

Re: [VOTE] Apache CarbonData 1.5.0(RC1) release

2018-09-26 Thread Liang Chen
Hi I would like to see these PRs be merged(2761, 2759) . Regards Liang ravipesala wrote > Hi > > I submit the Apache CarbonData 1.5.0 (RC1) for your vote. > > 1.Release Notes: > https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12320220=12341006 > > Some key features and